(venv) tech@Artax:/opt/metamirror/onnx_trt_utils$ trtexec --onnx=rvm_mobilenetv3_fp32_sim_modified_fp32.onnx --workspace=10000 --saveEngine=rvm_mobilenetv3_fp32_sim_modified.engine --verbose --explicitBatch &&&& RUNNING TensorRT.trtexec [TensorRT v8503] # trtexec --onnx=rvm_mobilenetv3_fp32_sim_modified_fp32.onnx --workspace=10000 --saveEngine=rvm_mobilenetv3_fp32_sim_modified.engine --verbose --explicitBatch [02/13/2023-19:49:58] [W] --explicitBatch flag has been deprecated and has no effect! [02/13/2023-19:49:58] [W] Explicit batch dim is automatically enabled if input model is ONNX or if dynamic shapes are provided when the engine is built. [02/13/2023-19:49:58] [W] --workspace flag has been deprecated by --memPoolSize flag. [02/13/2023-19:49:58] [I] === Model Options === [02/13/2023-19:49:58] [I] Format: ONNX [02/13/2023-19:49:58] [I] Model: rvm_mobilenetv3_fp32_sim_modified_fp32.onnx [02/13/2023-19:49:58] [I] Output: [02/13/2023-19:49:58] [I] === Build Options === [02/13/2023-19:49:58] [I] Max batch: explicit batch [02/13/2023-19:49:58] [I] Memory Pools: workspace: 10000 MiB, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default [02/13/2023-19:49:58] [I] minTiming: 1 [02/13/2023-19:49:58] [I] avgTiming: 8 [02/13/2023-19:49:58] [I] Precision: FP32 [02/13/2023-19:49:58] [I] LayerPrecisions: [02/13/2023-19:49:58] [I] Calibration: [02/13/2023-19:49:58] [I] Refit: Disabled [02/13/2023-19:49:58] [I] Sparsity: Disabled [02/13/2023-19:49:58] [I] Safe mode: Disabled [02/13/2023-19:49:58] [I] DirectIO mode: Disabled [02/13/2023-19:49:58] [I] Restricted mode: Disabled [02/13/2023-19:49:58] [I] Build only: Disabled [02/13/2023-19:49:58] [I] Save engine: rvm_mobilenetv3_fp32_sim_modified.engine [02/13/2023-19:49:58] [I] Load engine: [02/13/2023-19:49:58] [I] Profiling verbosity: 0 [02/13/2023-19:49:58] [I] Tactic sources: Using default tactic sources [02/13/2023-19:49:58] [I] timingCacheMode: local [02/13/2023-19:49:58] [I] timingCacheFile: [02/13/2023-19:49:58] [I] Heuristic: Disabled [02/13/2023-19:49:58] [I] Preview Features: Use default preview flags. [02/13/2023-19:49:58] [I] Input(s)s format: fp32:CHW [02/13/2023-19:49:58] [I] Output(s)s format: fp32:CHW [02/13/2023-19:49:58] [I] Input build shapes: model [02/13/2023-19:49:58] [I] Input calibration shapes: model [02/13/2023-19:49:58] [I] === System Options === [02/13/2023-19:49:58] [I] Device: 0 [02/13/2023-19:49:58] [I] DLACore: [02/13/2023-19:49:58] [I] Plugins: [02/13/2023-19:49:58] [I] === Inference Options === [02/13/2023-19:49:58] [I] Batch: Explicit [02/13/2023-19:49:58] [I] Input inference shapes: model [02/13/2023-19:49:58] [I] Iterations: 10 [02/13/2023-19:49:58] [I] Duration: 3s (+ 200ms warm up) [02/13/2023-19:49:58] [I] Sleep time: 0ms [02/13/2023-19:49:58] [I] Idle time: 0ms [02/13/2023-19:49:58] [I] Streams: 1 [02/13/2023-19:49:58] [I] ExposeDMA: Disabled [02/13/2023-19:49:58] [I] Data transfers: Enabled [02/13/2023-19:49:58] [I] Spin-wait: Disabled [02/13/2023-19:49:58] [I] Multithreading: Disabled [02/13/2023-19:49:58] [I] CUDA Graph: Disabled [02/13/2023-19:49:58] [I] Separate profiling: Disabled [02/13/2023-19:49:58] [I] Time Deserialize: Disabled [02/13/2023-19:49:58] [I] Time Refit: Disabled [02/13/2023-19:49:58] [I] NVTX verbosity: 0 [02/13/2023-19:49:58] [I] Persistent Cache Ratio: 0 [02/13/2023-19:49:58] [I] Inputs: [02/13/2023-19:49:58] [I] === Reporting Options === [02/13/2023-19:49:58] [I] Verbose: Enabled [02/13/2023-19:49:58] [I] Averages: 10 inferences [02/13/2023-19:49:58] [I] Percentiles: 90,95,99 [02/13/2023-19:49:58] [I] Dump refittable layers:Disabled [02/13/2023-19:49:58] [I] Dump output: Disabled [02/13/2023-19:49:58] [I] Profile: Disabled [02/13/2023-19:49:58] [I] Export timing to JSON file: [02/13/2023-19:49:58] [I] Export output to JSON file: [02/13/2023-19:49:58] [I] Export profile to JSON file: [02/13/2023-19:49:58] [I] [02/13/2023-19:49:58] [I] === Device Information === [02/13/2023-19:49:58] [I] Selected Device: Orin [02/13/2023-19:49:58] [I] Compute Capability: 8.7 [02/13/2023-19:49:58] [I] SMs: 16 [02/13/2023-19:49:58] [I] Compute Clock Rate: 1.3 GHz [02/13/2023-19:49:58] [I] Device Global Memory: 30535 MiB [02/13/2023-19:49:58] [I] Shared Memory per SM: 164 KiB [02/13/2023-19:49:58] [I] Memory Bus Width: 128 bits (ECC disabled) [02/13/2023-19:49:58] [I] Memory Clock Rate: 1.3 GHz [02/13/2023-19:49:58] [I] [02/13/2023-19:49:58] [I] TensorRT version: 8.5.3 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::ScatterND version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::BatchTilePlugin_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::CropAndResizeDynamic version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::EfficientNMS_Explicit_TF_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::EfficientNMS_Implicit_TF_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::ProposalDynamic version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::Proposal version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::Split version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 2 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::CoordConvAC version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::DecodeBbox3DPlugin version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::GenerateDetection_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::MultilevelCropAndResize_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::MultilevelProposeROI_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::NMSDynamic_TRT version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::PillarScatterPlugin version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::VoxelGeneratorPlugin version 1 [02/13/2023-19:49:58] [V] [TRT] Registered plugin creator - ::MultiscaleDeformableAttnPlugin_TRT version 1 [02/13/2023-19:49:58] [I] [TRT] [MemUsageChange] Init CUDA: CPU +218, GPU +0, now: CPU 242, GPU 8254 (MiB) [02/13/2023-19:50:02] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +351, GPU +462, now: CPU 612, GPU 8732 (MiB) [02/13/2023-19:50:02] [I] Start parsing network model [02/13/2023-19:50:02] [I] [TRT] ---------------------------------------------------------------- [02/13/2023-19:50:02] [I] [TRT] Input filename: rvm_mobilenetv3_fp32_sim_modified_fp32.onnx [02/13/2023-19:50:02] [I] [TRT] ONNX IR version: 0.0.8 [02/13/2023-19:50:02] [I] [TRT] Opset version: 12 [02/13/2023-19:50:02] [I] [TRT] Producer name: onnx-typecast [02/13/2023-19:50:02] [I] [TRT] Producer version: [02/13/2023-19:50:02] [I] [TRT] Domain: [02/13/2023-19:50:02] [I] [TRT] Model version: 0 [02/13/2023-19:50:02] [I] [TRT] Doc string: [02/13/2023-19:50:02] [I] [TRT] ---------------------------------------------------------------- [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::ScatterND version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::BatchTilePlugin_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::CropAndResizeDynamic version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Explicit_TF_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Implicit_TF_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::ProposalDynamic version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::Split version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 2 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::CoordConvAC version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::DecodeBbox3DPlugin version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::GenerateDetection_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::MultilevelCropAndResize_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::MultilevelProposeROI_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::NMSDynamic_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::PillarScatterPlugin version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::VoxelGeneratorPlugin version 1 [02/13/2023-19:50:02] [V] [TRT] Plugin creator already registered - ::MultiscaleDeformableAttnPlugin_TRT version 1 [02/13/2023-19:50:02] [V] [TRT] Adding network input: src with dtype: float32, dimensions: (1, 3, 1440, 2560) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: src for ONNX tensor: src [02/13/2023-19:50:02] [V] [TRT] Adding network input: r1i with dtype: float32, dimensions: (1, 1, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: r1i for ONNX tensor: r1i [02/13/2023-19:50:02] [V] [TRT] Adding network input: r2i with dtype: float32, dimensions: (1, 1, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: r2i for ONNX tensor: r2i [02/13/2023-19:50:02] [V] [TRT] Adding network input: r3i with dtype: float32, dimensions: (1, 1, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: r3i for ONNX tensor: r3i [02/13/2023-19:50:02] [V] [TRT] Adding network input: r4i with dtype: float32, dimensions: (1, 1, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: r4i for ONNX tensor: r4i [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 386 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 388 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 390 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 392 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 824 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 825 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 827 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 828 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 830 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 831 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 833 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 834 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 836 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 837 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 839 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 840 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 842 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 843 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 845 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 846 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 848 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 849 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 851 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 852 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 854 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 855 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.4.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.4.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.4.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.4.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 857 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 858 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 860 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 861 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 863 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 864 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.5.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.5.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.5.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.5.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 866 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 867 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 869 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 870 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 872 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 873 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.6.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.6.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.6.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.6.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 875 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 876 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 878 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 879 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 881 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 882 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 884 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 885 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 887 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 888 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 890 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 891 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 893 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 894 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 896 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 897 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 899 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 900 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 902 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 903 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 905 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 906 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 908 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 909 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 911 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 912 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 914 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 915 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 917 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 918 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.11.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.11.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.11.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.11.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 920 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 921 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 923 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 924 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 926 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 927 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.12.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.12.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.12.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.12.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 929 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 930 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 932 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 933 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 935 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 936 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.13.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.13.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.13.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.13.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 938 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 939 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 941 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 942 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 944 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 945 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.14.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.14.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.14.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.14.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 947 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 948 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 950 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 951 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 953 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 954 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.15.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.15.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.15.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: backbone.features.15.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 956 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 957 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 959 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 960 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 962 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 963 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: aspp.aspp2.1.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode4.gru.ih.0.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode4.gru.ih.0.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode4.gru.hh.0.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode4.gru.hh.0.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 990 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 985 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 630 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 631 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 632 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 634 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 635 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 965 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 966 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode3.gru.ih.0.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode3.gru.ih.0.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode3.gru.hh.0.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode3.gru.hh.0.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 968 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 969 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode2.gru.ih.0.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode2.gru.ih.0.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode2.gru.hh.0.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode2.gru.hh.0.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 971 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 972 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode1.gru.ih.0.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode1.gru.ih.0.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode1.gru.hh.0.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: decoder.decode1.gru.hh.0.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 974 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 975 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 977 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 978 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: project_mat.conv.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: project_mat.conv.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: refiner.box_filter.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 980 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 981 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 983 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 984 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: refiner.conv.6.weight [02/13/2023-19:50:02] [V] [TRT] Importing initializer: refiner.conv.6.bias [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 815 [02/13/2023-19:50:02] [V] [TRT] Importing initializer: 989 [02/13/2023-19:50:02] [V] [TRT] Parsing node: Resize_3 [Resize] [02/13/2023-19:50:02] [V] [TRT] Searching for input: src [02/13/2023-19:50:02] [V] [TRT] Searching for input: 386 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 388 [02/13/2023-19:50:02] [V] [TRT] Resize_3 [Resize] inputs: [src -> (1, 3, 1440, 2560)[FLOAT]], [386 -> (0)[FLOAT]], [388 -> (4)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Resize_3 for ONNX node: Resize_3 [02/13/2023-19:50:02] [V] [TRT] Running resize layer with: Transformation mode: pytorch_half_pixel Resize mode: linear [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 389 for ONNX tensor: 389 [02/13/2023-19:50:02] [V] [TRT] Resize_3 [Resize] outputs: [389 -> (1, 3, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Sub_5 [Sub] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 389 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 390 [02/13/2023-19:50:02] [V] [TRT] Sub_5 [Sub] inputs: [389 -> (1, 3, 288, 512)[FLOAT]], [390 -> (3, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: 390 for ONNX node: 390 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Sub_5 for ONNX node: Sub_5 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 391 for ONNX tensor: 391 [02/13/2023-19:50:02] [V] [TRT] Sub_5 [Sub] outputs: [391 -> (1, 3, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Div_7 [Div] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 391 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 392 [02/13/2023-19:50:02] [V] [TRT] Div_7 [Div] inputs: [391 -> (1, 3, 288, 512)[FLOAT]], [392 -> (3, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: 392 for ONNX node: 392 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Div_7 for ONNX node: Div_7 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 393 for ONNX tensor: 393 [02/13/2023-19:50:02] [V] [TRT] Div_7 [Div] outputs: [393 -> (1, 3, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_8 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 393 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 824 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 825 [02/13/2023-19:50:02] [V] [TRT] Conv_8 [Conv] inputs: [393 -> (1, 3, 288, 512)[FLOAT]], [824 -> (16, 3, 3, 3)[FLOAT]], [825 -> (16)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 3, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_8 for ONNX node: Conv_8 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 16, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 823 for ONNX tensor: 823 [02/13/2023-19:50:02] [V] [TRT] Conv_8 [Conv] outputs: [823 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_9 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 823 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_9 [HardSigmoid] inputs: [823 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_9 for ONNX node: HardSigmoid_9 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 396 for ONNX tensor: 396 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_9 [HardSigmoid] outputs: [396 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_10 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 823 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 396 [02/13/2023-19:50:02] [V] [TRT] Mul_10 [Mul] inputs: [823 -> (1, 16, 144, 256)[FLOAT]], [396 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_10 for ONNX node: Mul_10 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 397 for ONNX tensor: 397 [02/13/2023-19:50:02] [V] [TRT] Mul_10 [Mul] outputs: [397 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_11 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 397 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 827 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 828 [02/13/2023-19:50:02] [V] [TRT] Conv_11 [Conv] inputs: [397 -> (1, 16, 144, 256)[FLOAT]], [827 -> (16, 1, 3, 3)[FLOAT]], [828 -> (16)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 16, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_11 for ONNX node: Conv_11 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 16, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 826 for ONNX tensor: 826 [02/13/2023-19:50:02] [V] [TRT] Conv_11 [Conv] outputs: [826 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_12 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 826 [02/13/2023-19:50:02] [V] [TRT] Relu_12 [Relu] inputs: [826 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_12 for ONNX node: Relu_12 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 400 for ONNX tensor: 400 [02/13/2023-19:50:02] [V] [TRT] Relu_12 [Relu] outputs: [400 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_13 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 400 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 830 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 831 [02/13/2023-19:50:02] [V] [TRT] Conv_13 [Conv] inputs: [400 -> (1, 16, 144, 256)[FLOAT]], [830 -> (16, 16, 1, 1)[FLOAT]], [831 -> (16)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 16, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_13 for ONNX node: Conv_13 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 16 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 16, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 829 for ONNX tensor: 829 [02/13/2023-19:50:02] [V] [TRT] Conv_13 [Conv] outputs: [829 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_14 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 829 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 397 [02/13/2023-19:50:02] [V] [TRT] Add_14 [Add] inputs: [829 -> (1, 16, 144, 256)[FLOAT]], [397 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_14 for ONNX node: Add_14 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 403 for ONNX tensor: 403 [02/13/2023-19:50:02] [V] [TRT] Add_14 [Add] outputs: [403 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_15 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 403 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 833 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 834 [02/13/2023-19:50:02] [V] [TRT] Conv_15 [Conv] inputs: [403 -> (1, 16, 144, 256)[FLOAT]], [833 -> (64, 16, 1, 1)[FLOAT]], [834 -> (64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 16, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_15 for ONNX node: Conv_15 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 64, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 832 for ONNX tensor: 832 [02/13/2023-19:50:02] [V] [TRT] Conv_15 [Conv] outputs: [832 -> (1, 64, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_16 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 832 [02/13/2023-19:50:02] [V] [TRT] Relu_16 [Relu] inputs: [832 -> (1, 64, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_16 for ONNX node: Relu_16 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 406 for ONNX tensor: 406 [02/13/2023-19:50:02] [V] [TRT] Relu_16 [Relu] outputs: [406 -> (1, 64, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_17 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 406 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 836 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 837 [02/13/2023-19:50:02] [V] [TRT] Conv_17 [Conv] inputs: [406 -> (1, 64, 144, 256)[FLOAT]], [836 -> (64, 1, 3, 3)[FLOAT]], [837 -> (64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 64, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_17 for ONNX node: Conv_17 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 64, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 835 for ONNX tensor: 835 [02/13/2023-19:50:02] [V] [TRT] Conv_17 [Conv] outputs: [835 -> (1, 64, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_18 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 835 [02/13/2023-19:50:02] [V] [TRT] Relu_18 [Relu] inputs: [835 -> (1, 64, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_18 for ONNX node: Relu_18 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 409 for ONNX tensor: 409 [02/13/2023-19:50:02] [V] [TRT] Relu_18 [Relu] outputs: [409 -> (1, 64, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_19 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 409 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 839 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 840 [02/13/2023-19:50:02] [V] [TRT] Conv_19 [Conv] inputs: [409 -> (1, 64, 72, 128)[FLOAT]], [839 -> (24, 64, 1, 1)[FLOAT]], [840 -> (24)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 64, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_19 for ONNX node: Conv_19 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 24, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 838 for ONNX tensor: 838 [02/13/2023-19:50:02] [V] [TRT] Conv_19 [Conv] outputs: [838 -> (1, 24, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_20 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 838 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 842 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 843 [02/13/2023-19:50:02] [V] [TRT] Conv_20 [Conv] inputs: [838 -> (1, 24, 72, 128)[FLOAT]], [842 -> (72, 24, 1, 1)[FLOAT]], [843 -> (72)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 24, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_20 for ONNX node: Conv_20 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 72 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 72, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 841 for ONNX tensor: 841 [02/13/2023-19:50:02] [V] [TRT] Conv_20 [Conv] outputs: [841 -> (1, 72, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_21 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 841 [02/13/2023-19:50:02] [V] [TRT] Relu_21 [Relu] inputs: [841 -> (1, 72, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_21 for ONNX node: Relu_21 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 414 for ONNX tensor: 414 [02/13/2023-19:50:02] [V] [TRT] Relu_21 [Relu] outputs: [414 -> (1, 72, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_22 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 414 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 845 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 846 [02/13/2023-19:50:02] [V] [TRT] Conv_22 [Conv] inputs: [414 -> (1, 72, 72, 128)[FLOAT]], [845 -> (72, 1, 3, 3)[FLOAT]], [846 -> (72)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 72, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_22 for ONNX node: Conv_22 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 72 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 72, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 844 for ONNX tensor: 844 [02/13/2023-19:50:02] [V] [TRT] Conv_22 [Conv] outputs: [844 -> (1, 72, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_23 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 844 [02/13/2023-19:50:02] [V] [TRT] Relu_23 [Relu] inputs: [844 -> (1, 72, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_23 for ONNX node: Relu_23 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 417 for ONNX tensor: 417 [02/13/2023-19:50:02] [V] [TRT] Relu_23 [Relu] outputs: [417 -> (1, 72, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_24 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 417 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 848 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 849 [02/13/2023-19:50:02] [V] [TRT] Conv_24 [Conv] inputs: [417 -> (1, 72, 72, 128)[FLOAT]], [848 -> (24, 72, 1, 1)[FLOAT]], [849 -> (24)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 72, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_24 for ONNX node: Conv_24 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 24, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 847 for ONNX tensor: 847 [02/13/2023-19:50:02] [V] [TRT] Conv_24 [Conv] outputs: [847 -> (1, 24, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_25 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 847 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 838 [02/13/2023-19:50:02] [V] [TRT] Add_25 [Add] inputs: [847 -> (1, 24, 72, 128)[FLOAT]], [838 -> (1, 24, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_25 for ONNX node: Add_25 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 420 for ONNX tensor: 420 [02/13/2023-19:50:02] [V] [TRT] Add_25 [Add] outputs: [420 -> (1, 24, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_26 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 420 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 851 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 852 [02/13/2023-19:50:02] [V] [TRT] Conv_26 [Conv] inputs: [420 -> (1, 24, 72, 128)[FLOAT]], [851 -> (72, 24, 1, 1)[FLOAT]], [852 -> (72)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 24, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_26 for ONNX node: Conv_26 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 72 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 72, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 850 for ONNX tensor: 850 [02/13/2023-19:50:02] [V] [TRT] Conv_26 [Conv] outputs: [850 -> (1, 72, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_27 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 850 [02/13/2023-19:50:02] [V] [TRT] Relu_27 [Relu] inputs: [850 -> (1, 72, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_27 for ONNX node: Relu_27 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 423 for ONNX tensor: 423 [02/13/2023-19:50:02] [V] [TRT] Relu_27 [Relu] outputs: [423 -> (1, 72, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_28 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 423 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 854 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 855 [02/13/2023-19:50:02] [V] [TRT] Conv_28 [Conv] inputs: [423 -> (1, 72, 72, 128)[FLOAT]], [854 -> (72, 1, 5, 5)[FLOAT]], [855 -> (72)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 72, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_28 for ONNX node: Conv_28 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (5, 5), strides: (2, 2), prepadding: (2, 2), postpadding: (2, 2), dilations: (1, 1), numOutputs: 72 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 72, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 853 for ONNX tensor: 853 [02/13/2023-19:50:02] [V] [TRT] Conv_28 [Conv] outputs: [853 -> (1, 72, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_29 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 853 [02/13/2023-19:50:02] [V] [TRT] Relu_29 [Relu] inputs: [853 -> (1, 72, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_29 for ONNX node: Relu_29 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 426 for ONNX tensor: 426 [02/13/2023-19:50:02] [V] [TRT] Relu_29 [Relu] outputs: [426 -> (1, 72, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: GlobalAveragePool_30 [GlobalAveragePool] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 426 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_30 [GlobalAveragePool] inputs: [426 -> (1, 72, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool operators are implemented via Reduce layers rather than Pooling layers [02/13/2023-19:50:02] [V] [TRT] Registering layer: GlobalAveragePool_30 for ONNX node: GlobalAveragePool_30 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 427 for ONNX tensor: 427 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_30 [GlobalAveragePool] outputs: [427 -> (1, 72, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_31 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 427 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.4.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.4.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Conv_31 [Conv] inputs: [427 -> (1, 72, 1, 1)[FLOAT]], [backbone.features.4.block.2.fc1.weight -> (24, 72, 1, 1)[FLOAT]], [backbone.features.4.block.2.fc1.bias -> (24)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 72, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_31 for ONNX node: Conv_31 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 24, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 428 for ONNX tensor: 428 [02/13/2023-19:50:02] [V] [TRT] Conv_31 [Conv] outputs: [428 -> (1, 24, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_32 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 428 [02/13/2023-19:50:02] [V] [TRT] Relu_32 [Relu] inputs: [428 -> (1, 24, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_32 for ONNX node: Relu_32 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 429 for ONNX tensor: 429 [02/13/2023-19:50:02] [V] [TRT] Relu_32 [Relu] outputs: [429 -> (1, 24, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_33 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 429 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.4.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.4.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Conv_33 [Conv] inputs: [429 -> (1, 24, 1, 1)[FLOAT]], [backbone.features.4.block.2.fc2.weight -> (72, 24, 1, 1)[FLOAT]], [backbone.features.4.block.2.fc2.bias -> (72)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 24, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_33 for ONNX node: Conv_33 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 72 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 72, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 430 for ONNX tensor: 430 [02/13/2023-19:50:02] [V] [TRT] Conv_33 [Conv] outputs: [430 -> (1, 72, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_34 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 430 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_34 [HardSigmoid] inputs: [430 -> (1, 72, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_34 for ONNX node: HardSigmoid_34 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 431 for ONNX tensor: 431 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_34 [HardSigmoid] outputs: [431 -> (1, 72, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_35 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 431 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 426 [02/13/2023-19:50:02] [V] [TRT] Mul_35 [Mul] inputs: [431 -> (1, 72, 1, 1)[FLOAT]], [426 -> (1, 72, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_35 for ONNX node: Mul_35 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 432 for ONNX tensor: 432 [02/13/2023-19:50:02] [V] [TRT] Mul_35 [Mul] outputs: [432 -> (1, 72, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_36 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 432 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 857 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 858 [02/13/2023-19:50:02] [V] [TRT] Conv_36 [Conv] inputs: [432 -> (1, 72, 36, 64)[FLOAT]], [857 -> (40, 72, 1, 1)[FLOAT]], [858 -> (40)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 72, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_36 for ONNX node: Conv_36 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 40 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 40, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 856 for ONNX tensor: 856 [02/13/2023-19:50:02] [V] [TRT] Conv_36 [Conv] outputs: [856 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_37 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 856 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 860 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 861 [02/13/2023-19:50:02] [V] [TRT] Conv_37 [Conv] inputs: [856 -> (1, 40, 36, 64)[FLOAT]], [860 -> (120, 40, 1, 1)[FLOAT]], [861 -> (120)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 40, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_37 for ONNX node: Conv_37 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 120 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 120, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 859 for ONNX tensor: 859 [02/13/2023-19:50:02] [V] [TRT] Conv_37 [Conv] outputs: [859 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_38 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 859 [02/13/2023-19:50:02] [V] [TRT] Relu_38 [Relu] inputs: [859 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_38 for ONNX node: Relu_38 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 437 for ONNX tensor: 437 [02/13/2023-19:50:02] [V] [TRT] Relu_38 [Relu] outputs: [437 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_39 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 437 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 863 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 864 [02/13/2023-19:50:02] [V] [TRT] Conv_39 [Conv] inputs: [437 -> (1, 120, 36, 64)[FLOAT]], [863 -> (120, 1, 5, 5)[FLOAT]], [864 -> (120)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 120, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_39 for ONNX node: Conv_39 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (5, 5), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (1, 1), numOutputs: 120 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 120, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 862 for ONNX tensor: 862 [02/13/2023-19:50:02] [V] [TRT] Conv_39 [Conv] outputs: [862 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_40 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 862 [02/13/2023-19:50:02] [V] [TRT] Relu_40 [Relu] inputs: [862 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_40 for ONNX node: Relu_40 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 440 for ONNX tensor: 440 [02/13/2023-19:50:02] [V] [TRT] Relu_40 [Relu] outputs: [440 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: GlobalAveragePool_41 [GlobalAveragePool] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 440 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_41 [GlobalAveragePool] inputs: [440 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool operators are implemented via Reduce layers rather than Pooling layers [02/13/2023-19:50:02] [V] [TRT] Registering layer: GlobalAveragePool_41 for ONNX node: GlobalAveragePool_41 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 441 for ONNX tensor: 441 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_41 [GlobalAveragePool] outputs: [441 -> (1, 120, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_42 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 441 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.5.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.5.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Conv_42 [Conv] inputs: [441 -> (1, 120, 1, 1)[FLOAT]], [backbone.features.5.block.2.fc1.weight -> (32, 120, 1, 1)[FLOAT]], [backbone.features.5.block.2.fc1.bias -> (32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 120, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_42 for ONNX node: Conv_42 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 32, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 442 for ONNX tensor: 442 [02/13/2023-19:50:02] [V] [TRT] Conv_42 [Conv] outputs: [442 -> (1, 32, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_43 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 442 [02/13/2023-19:50:02] [V] [TRT] Relu_43 [Relu] inputs: [442 -> (1, 32, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_43 for ONNX node: Relu_43 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 443 for ONNX tensor: 443 [02/13/2023-19:50:02] [V] [TRT] Relu_43 [Relu] outputs: [443 -> (1, 32, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_44 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 443 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.5.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.5.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Conv_44 [Conv] inputs: [443 -> (1, 32, 1, 1)[FLOAT]], [backbone.features.5.block.2.fc2.weight -> (120, 32, 1, 1)[FLOAT]], [backbone.features.5.block.2.fc2.bias -> (120)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 32, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_44 for ONNX node: Conv_44 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 120 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 120, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 444 for ONNX tensor: 444 [02/13/2023-19:50:02] [V] [TRT] Conv_44 [Conv] outputs: [444 -> (1, 120, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_45 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 444 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_45 [HardSigmoid] inputs: [444 -> (1, 120, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_45 for ONNX node: HardSigmoid_45 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 445 for ONNX tensor: 445 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_45 [HardSigmoid] outputs: [445 -> (1, 120, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_46 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 445 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 440 [02/13/2023-19:50:02] [V] [TRT] Mul_46 [Mul] inputs: [445 -> (1, 120, 1, 1)[FLOAT]], [440 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_46 for ONNX node: Mul_46 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 446 for ONNX tensor: 446 [02/13/2023-19:50:02] [V] [TRT] Mul_46 [Mul] outputs: [446 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_47 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 446 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 866 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 867 [02/13/2023-19:50:02] [V] [TRT] Conv_47 [Conv] inputs: [446 -> (1, 120, 36, 64)[FLOAT]], [866 -> (40, 120, 1, 1)[FLOAT]], [867 -> (40)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 120, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_47 for ONNX node: Conv_47 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 40 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 40, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 865 for ONNX tensor: 865 [02/13/2023-19:50:02] [V] [TRT] Conv_47 [Conv] outputs: [865 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_48 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 865 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 856 [02/13/2023-19:50:02] [V] [TRT] Add_48 [Add] inputs: [865 -> (1, 40, 36, 64)[FLOAT]], [856 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_48 for ONNX node: Add_48 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 449 for ONNX tensor: 449 [02/13/2023-19:50:02] [V] [TRT] Add_48 [Add] outputs: [449 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_49 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 449 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 869 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 870 [02/13/2023-19:50:02] [V] [TRT] Conv_49 [Conv] inputs: [449 -> (1, 40, 36, 64)[FLOAT]], [869 -> (120, 40, 1, 1)[FLOAT]], [870 -> (120)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 40, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_49 for ONNX node: Conv_49 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 120 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 120, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 868 for ONNX tensor: 868 [02/13/2023-19:50:02] [V] [TRT] Conv_49 [Conv] outputs: [868 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_50 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 868 [02/13/2023-19:50:02] [V] [TRT] Relu_50 [Relu] inputs: [868 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_50 for ONNX node: Relu_50 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 452 for ONNX tensor: 452 [02/13/2023-19:50:02] [V] [TRT] Relu_50 [Relu] outputs: [452 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_51 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 452 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 872 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 873 [02/13/2023-19:50:02] [V] [TRT] Conv_51 [Conv] inputs: [452 -> (1, 120, 36, 64)[FLOAT]], [872 -> (120, 1, 5, 5)[FLOAT]], [873 -> (120)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 120, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_51 for ONNX node: Conv_51 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (5, 5), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (1, 1), numOutputs: 120 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 120, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 871 for ONNX tensor: 871 [02/13/2023-19:50:02] [V] [TRT] Conv_51 [Conv] outputs: [871 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_52 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 871 [02/13/2023-19:50:02] [V] [TRT] Relu_52 [Relu] inputs: [871 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_52 for ONNX node: Relu_52 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 455 for ONNX tensor: 455 [02/13/2023-19:50:02] [V] [TRT] Relu_52 [Relu] outputs: [455 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: GlobalAveragePool_53 [GlobalAveragePool] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 455 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_53 [GlobalAveragePool] inputs: [455 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool operators are implemented via Reduce layers rather than Pooling layers [02/13/2023-19:50:02] [V] [TRT] Registering layer: GlobalAveragePool_53 for ONNX node: GlobalAveragePool_53 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 456 for ONNX tensor: 456 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_53 [GlobalAveragePool] outputs: [456 -> (1, 120, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_54 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 456 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.6.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.6.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Conv_54 [Conv] inputs: [456 -> (1, 120, 1, 1)[FLOAT]], [backbone.features.6.block.2.fc1.weight -> (32, 120, 1, 1)[FLOAT]], [backbone.features.6.block.2.fc1.bias -> (32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 120, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_54 for ONNX node: Conv_54 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 32, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 457 for ONNX tensor: 457 [02/13/2023-19:50:02] [V] [TRT] Conv_54 [Conv] outputs: [457 -> (1, 32, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_55 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 457 [02/13/2023-19:50:02] [V] [TRT] Relu_55 [Relu] inputs: [457 -> (1, 32, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_55 for ONNX node: Relu_55 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 458 for ONNX tensor: 458 [02/13/2023-19:50:02] [V] [TRT] Relu_55 [Relu] outputs: [458 -> (1, 32, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_56 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 458 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.6.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.6.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Conv_56 [Conv] inputs: [458 -> (1, 32, 1, 1)[FLOAT]], [backbone.features.6.block.2.fc2.weight -> (120, 32, 1, 1)[FLOAT]], [backbone.features.6.block.2.fc2.bias -> (120)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 32, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_56 for ONNX node: Conv_56 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 120 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 120, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 459 for ONNX tensor: 459 [02/13/2023-19:50:02] [V] [TRT] Conv_56 [Conv] outputs: [459 -> (1, 120, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_57 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 459 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_57 [HardSigmoid] inputs: [459 -> (1, 120, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_57 for ONNX node: HardSigmoid_57 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 460 for ONNX tensor: 460 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_57 [HardSigmoid] outputs: [460 -> (1, 120, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_58 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 460 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 455 [02/13/2023-19:50:02] [V] [TRT] Mul_58 [Mul] inputs: [460 -> (1, 120, 1, 1)[FLOAT]], [455 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_58 for ONNX node: Mul_58 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 461 for ONNX tensor: 461 [02/13/2023-19:50:02] [V] [TRT] Mul_58 [Mul] outputs: [461 -> (1, 120, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_59 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 461 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 875 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 876 [02/13/2023-19:50:02] [V] [TRT] Conv_59 [Conv] inputs: [461 -> (1, 120, 36, 64)[FLOAT]], [875 -> (40, 120, 1, 1)[FLOAT]], [876 -> (40)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 120, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_59 for ONNX node: Conv_59 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 40 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 40, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 874 for ONNX tensor: 874 [02/13/2023-19:50:02] [V] [TRT] Conv_59 [Conv] outputs: [874 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_60 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 874 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 449 [02/13/2023-19:50:02] [V] [TRT] Add_60 [Add] inputs: [874 -> (1, 40, 36, 64)[FLOAT]], [449 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_60 for ONNX node: Add_60 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 464 for ONNX tensor: 464 [02/13/2023-19:50:02] [V] [TRT] Add_60 [Add] outputs: [464 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_61 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 464 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 878 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 879 [02/13/2023-19:50:02] [V] [TRT] Conv_61 [Conv] inputs: [464 -> (1, 40, 36, 64)[FLOAT]], [878 -> (240, 40, 1, 1)[FLOAT]], [879 -> (240)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 40, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_61 for ONNX node: Conv_61 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 240 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 240, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 877 for ONNX tensor: 877 [02/13/2023-19:50:02] [V] [TRT] Conv_61 [Conv] outputs: [877 -> (1, 240, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_62 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 877 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_62 [HardSigmoid] inputs: [877 -> (1, 240, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_62 for ONNX node: HardSigmoid_62 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 467 for ONNX tensor: 467 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_62 [HardSigmoid] outputs: [467 -> (1, 240, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_63 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 877 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 467 [02/13/2023-19:50:02] [V] [TRT] Mul_63 [Mul] inputs: [877 -> (1, 240, 36, 64)[FLOAT]], [467 -> (1, 240, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_63 for ONNX node: Mul_63 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 468 for ONNX tensor: 468 [02/13/2023-19:50:02] [V] [TRT] Mul_63 [Mul] outputs: [468 -> (1, 240, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_64 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 468 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 881 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 882 [02/13/2023-19:50:02] [V] [TRT] Conv_64 [Conv] inputs: [468 -> (1, 240, 36, 64)[FLOAT]], [881 -> (240, 1, 3, 3)[FLOAT]], [882 -> (240)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 240, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_64 for ONNX node: Conv_64 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 240 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 240, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 880 for ONNX tensor: 880 [02/13/2023-19:50:02] [V] [TRT] Conv_64 [Conv] outputs: [880 -> (1, 240, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_65 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 880 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_65 [HardSigmoid] inputs: [880 -> (1, 240, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_65 for ONNX node: HardSigmoid_65 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 471 for ONNX tensor: 471 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_65 [HardSigmoid] outputs: [471 -> (1, 240, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_66 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 880 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 471 [02/13/2023-19:50:02] [V] [TRT] Mul_66 [Mul] inputs: [880 -> (1, 240, 18, 32)[FLOAT]], [471 -> (1, 240, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_66 for ONNX node: Mul_66 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 472 for ONNX tensor: 472 [02/13/2023-19:50:02] [V] [TRT] Mul_66 [Mul] outputs: [472 -> (1, 240, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_67 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 472 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 884 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 885 [02/13/2023-19:50:02] [V] [TRT] Conv_67 [Conv] inputs: [472 -> (1, 240, 18, 32)[FLOAT]], [884 -> (80, 240, 1, 1)[FLOAT]], [885 -> (80)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 240, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_67 for ONNX node: Conv_67 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 80, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 883 for ONNX tensor: 883 [02/13/2023-19:50:02] [V] [TRT] Conv_67 [Conv] outputs: [883 -> (1, 80, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_68 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 883 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 887 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 888 [02/13/2023-19:50:02] [V] [TRT] Conv_68 [Conv] inputs: [883 -> (1, 80, 18, 32)[FLOAT]], [887 -> (200, 80, 1, 1)[FLOAT]], [888 -> (200)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 80, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_68 for ONNX node: Conv_68 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 200 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 200, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 886 for ONNX tensor: 886 [02/13/2023-19:50:02] [V] [TRT] Conv_68 [Conv] outputs: [886 -> (1, 200, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_69 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 886 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_69 [HardSigmoid] inputs: [886 -> (1, 200, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_69 for ONNX node: HardSigmoid_69 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 477 for ONNX tensor: 477 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_69 [HardSigmoid] outputs: [477 -> (1, 200, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_70 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 886 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 477 [02/13/2023-19:50:02] [V] [TRT] Mul_70 [Mul] inputs: [886 -> (1, 200, 18, 32)[FLOAT]], [477 -> (1, 200, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_70 for ONNX node: Mul_70 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 478 for ONNX tensor: 478 [02/13/2023-19:50:02] [V] [TRT] Mul_70 [Mul] outputs: [478 -> (1, 200, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_71 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 478 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 890 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 891 [02/13/2023-19:50:02] [V] [TRT] Conv_71 [Conv] inputs: [478 -> (1, 200, 18, 32)[FLOAT]], [890 -> (200, 1, 3, 3)[FLOAT]], [891 -> (200)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 200, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_71 for ONNX node: Conv_71 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 200 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 200, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 889 for ONNX tensor: 889 [02/13/2023-19:50:02] [V] [TRT] Conv_71 [Conv] outputs: [889 -> (1, 200, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_72 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 889 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_72 [HardSigmoid] inputs: [889 -> (1, 200, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_72 for ONNX node: HardSigmoid_72 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 481 for ONNX tensor: 481 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_72 [HardSigmoid] outputs: [481 -> (1, 200, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_73 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 889 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 481 [02/13/2023-19:50:02] [V] [TRT] Mul_73 [Mul] inputs: [889 -> (1, 200, 18, 32)[FLOAT]], [481 -> (1, 200, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_73 for ONNX node: Mul_73 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 482 for ONNX tensor: 482 [02/13/2023-19:50:02] [V] [TRT] Mul_73 [Mul] outputs: [482 -> (1, 200, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_74 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 482 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 893 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 894 [02/13/2023-19:50:02] [V] [TRT] Conv_74 [Conv] inputs: [482 -> (1, 200, 18, 32)[FLOAT]], [893 -> (80, 200, 1, 1)[FLOAT]], [894 -> (80)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 200, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_74 for ONNX node: Conv_74 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 80, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 892 for ONNX tensor: 892 [02/13/2023-19:50:02] [V] [TRT] Conv_74 [Conv] outputs: [892 -> (1, 80, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_75 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 892 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 883 [02/13/2023-19:50:02] [V] [TRT] Add_75 [Add] inputs: [892 -> (1, 80, 18, 32)[FLOAT]], [883 -> (1, 80, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_75 for ONNX node: Add_75 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 485 for ONNX tensor: 485 [02/13/2023-19:50:02] [V] [TRT] Add_75 [Add] outputs: [485 -> (1, 80, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_76 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 485 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 896 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 897 [02/13/2023-19:50:02] [V] [TRT] Conv_76 [Conv] inputs: [485 -> (1, 80, 18, 32)[FLOAT]], [896 -> (184, 80, 1, 1)[FLOAT]], [897 -> (184)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 80, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_76 for ONNX node: Conv_76 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 184 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 184, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 895 for ONNX tensor: 895 [02/13/2023-19:50:02] [V] [TRT] Conv_76 [Conv] outputs: [895 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_77 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 895 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_77 [HardSigmoid] inputs: [895 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_77 for ONNX node: HardSigmoid_77 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 488 for ONNX tensor: 488 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_77 [HardSigmoid] outputs: [488 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_78 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 895 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 488 [02/13/2023-19:50:02] [V] [TRT] Mul_78 [Mul] inputs: [895 -> (1, 184, 18, 32)[FLOAT]], [488 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_78 for ONNX node: Mul_78 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 489 for ONNX tensor: 489 [02/13/2023-19:50:02] [V] [TRT] Mul_78 [Mul] outputs: [489 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_79 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 489 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 899 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 900 [02/13/2023-19:50:02] [V] [TRT] Conv_79 [Conv] inputs: [489 -> (1, 184, 18, 32)[FLOAT]], [899 -> (184, 1, 3, 3)[FLOAT]], [900 -> (184)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 184, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_79 for ONNX node: Conv_79 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 184 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 184, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 898 for ONNX tensor: 898 [02/13/2023-19:50:02] [V] [TRT] Conv_79 [Conv] outputs: [898 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_80 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 898 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_80 [HardSigmoid] inputs: [898 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_80 for ONNX node: HardSigmoid_80 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 492 for ONNX tensor: 492 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_80 [HardSigmoid] outputs: [492 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_81 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 898 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 492 [02/13/2023-19:50:02] [V] [TRT] Mul_81 [Mul] inputs: [898 -> (1, 184, 18, 32)[FLOAT]], [492 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_81 for ONNX node: Mul_81 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 493 for ONNX tensor: 493 [02/13/2023-19:50:02] [V] [TRT] Mul_81 [Mul] outputs: [493 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_82 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 493 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 902 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 903 [02/13/2023-19:50:02] [V] [TRT] Conv_82 [Conv] inputs: [493 -> (1, 184, 18, 32)[FLOAT]], [902 -> (80, 184, 1, 1)[FLOAT]], [903 -> (80)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 184, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_82 for ONNX node: Conv_82 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 80, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 901 for ONNX tensor: 901 [02/13/2023-19:50:02] [V] [TRT] Conv_82 [Conv] outputs: [901 -> (1, 80, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_83 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 901 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 485 [02/13/2023-19:50:02] [V] [TRT] Add_83 [Add] inputs: [901 -> (1, 80, 18, 32)[FLOAT]], [485 -> (1, 80, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_83 for ONNX node: Add_83 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 496 for ONNX tensor: 496 [02/13/2023-19:50:02] [V] [TRT] Add_83 [Add] outputs: [496 -> (1, 80, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_84 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 496 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 905 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 906 [02/13/2023-19:50:02] [V] [TRT] Conv_84 [Conv] inputs: [496 -> (1, 80, 18, 32)[FLOAT]], [905 -> (184, 80, 1, 1)[FLOAT]], [906 -> (184)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 80, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_84 for ONNX node: Conv_84 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 184 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 184, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 904 for ONNX tensor: 904 [02/13/2023-19:50:02] [V] [TRT] Conv_84 [Conv] outputs: [904 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_85 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 904 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_85 [HardSigmoid] inputs: [904 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_85 for ONNX node: HardSigmoid_85 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 499 for ONNX tensor: 499 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_85 [HardSigmoid] outputs: [499 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_86 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 904 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 499 [02/13/2023-19:50:02] [V] [TRT] Mul_86 [Mul] inputs: [904 -> (1, 184, 18, 32)[FLOAT]], [499 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_86 for ONNX node: Mul_86 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 500 for ONNX tensor: 500 [02/13/2023-19:50:02] [V] [TRT] Mul_86 [Mul] outputs: [500 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_87 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 500 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 908 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 909 [02/13/2023-19:50:02] [V] [TRT] Conv_87 [Conv] inputs: [500 -> (1, 184, 18, 32)[FLOAT]], [908 -> (184, 1, 3, 3)[FLOAT]], [909 -> (184)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 184, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_87 for ONNX node: Conv_87 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 184 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 184, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 907 for ONNX tensor: 907 [02/13/2023-19:50:02] [V] [TRT] Conv_87 [Conv] outputs: [907 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_88 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 907 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_88 [HardSigmoid] inputs: [907 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_88 for ONNX node: HardSigmoid_88 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 503 for ONNX tensor: 503 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_88 [HardSigmoid] outputs: [503 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_89 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 907 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 503 [02/13/2023-19:50:02] [V] [TRT] Mul_89 [Mul] inputs: [907 -> (1, 184, 18, 32)[FLOAT]], [503 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_89 for ONNX node: Mul_89 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 504 for ONNX tensor: 504 [02/13/2023-19:50:02] [V] [TRT] Mul_89 [Mul] outputs: [504 -> (1, 184, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_90 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 504 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 911 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 912 [02/13/2023-19:50:02] [V] [TRT] Conv_90 [Conv] inputs: [504 -> (1, 184, 18, 32)[FLOAT]], [911 -> (80, 184, 1, 1)[FLOAT]], [912 -> (80)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 184, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_90 for ONNX node: Conv_90 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 80, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 910 for ONNX tensor: 910 [02/13/2023-19:50:02] [V] [TRT] Conv_90 [Conv] outputs: [910 -> (1, 80, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_91 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 910 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 496 [02/13/2023-19:50:02] [V] [TRT] Add_91 [Add] inputs: [910 -> (1, 80, 18, 32)[FLOAT]], [496 -> (1, 80, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_91 for ONNX node: Add_91 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 507 for ONNX tensor: 507 [02/13/2023-19:50:02] [V] [TRT] Add_91 [Add] outputs: [507 -> (1, 80, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_92 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 507 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 914 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 915 [02/13/2023-19:50:02] [V] [TRT] Conv_92 [Conv] inputs: [507 -> (1, 80, 18, 32)[FLOAT]], [914 -> (480, 80, 1, 1)[FLOAT]], [915 -> (480)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 80, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_92 for ONNX node: Conv_92 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 480 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 480, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 913 for ONNX tensor: 913 [02/13/2023-19:50:02] [V] [TRT] Conv_92 [Conv] outputs: [913 -> (1, 480, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_93 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 913 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_93 [HardSigmoid] inputs: [913 -> (1, 480, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_93 for ONNX node: HardSigmoid_93 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 510 for ONNX tensor: 510 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_93 [HardSigmoid] outputs: [510 -> (1, 480, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_94 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 913 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 510 [02/13/2023-19:50:02] [V] [TRT] Mul_94 [Mul] inputs: [913 -> (1, 480, 18, 32)[FLOAT]], [510 -> (1, 480, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_94 for ONNX node: Mul_94 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 511 for ONNX tensor: 511 [02/13/2023-19:50:02] [V] [TRT] Mul_94 [Mul] outputs: [511 -> (1, 480, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_95 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 511 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 917 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 918 [02/13/2023-19:50:02] [V] [TRT] Conv_95 [Conv] inputs: [511 -> (1, 480, 18, 32)[FLOAT]], [917 -> (480, 1, 3, 3)[FLOAT]], [918 -> (480)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 480, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_95 for ONNX node: Conv_95 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 480 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 480, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 916 for ONNX tensor: 916 [02/13/2023-19:50:02] [V] [TRT] Conv_95 [Conv] outputs: [916 -> (1, 480, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_96 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 916 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_96 [HardSigmoid] inputs: [916 -> (1, 480, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_96 for ONNX node: HardSigmoid_96 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 514 for ONNX tensor: 514 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_96 [HardSigmoid] outputs: [514 -> (1, 480, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_97 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 916 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 514 [02/13/2023-19:50:02] [V] [TRT] Mul_97 [Mul] inputs: [916 -> (1, 480, 18, 32)[FLOAT]], [514 -> (1, 480, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_97 for ONNX node: Mul_97 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 515 for ONNX tensor: 515 [02/13/2023-19:50:02] [V] [TRT] Mul_97 [Mul] outputs: [515 -> (1, 480, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: GlobalAveragePool_98 [GlobalAveragePool] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 515 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_98 [GlobalAveragePool] inputs: [515 -> (1, 480, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool operators are implemented via Reduce layers rather than Pooling layers [02/13/2023-19:50:02] [V] [TRT] Registering layer: GlobalAveragePool_98 for ONNX node: GlobalAveragePool_98 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 516 for ONNX tensor: 516 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_98 [GlobalAveragePool] outputs: [516 -> (1, 480, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_99 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 516 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.11.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.11.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Conv_99 [Conv] inputs: [516 -> (1, 480, 1, 1)[FLOAT]], [backbone.features.11.block.2.fc1.weight -> (120, 480, 1, 1)[FLOAT]], [backbone.features.11.block.2.fc1.bias -> (120)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 480, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_99 for ONNX node: Conv_99 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 120 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 120, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 517 for ONNX tensor: 517 [02/13/2023-19:50:02] [V] [TRT] Conv_99 [Conv] outputs: [517 -> (1, 120, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_100 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 517 [02/13/2023-19:50:02] [V] [TRT] Relu_100 [Relu] inputs: [517 -> (1, 120, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_100 for ONNX node: Relu_100 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 518 for ONNX tensor: 518 [02/13/2023-19:50:02] [V] [TRT] Relu_100 [Relu] outputs: [518 -> (1, 120, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_101 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 518 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.11.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.11.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Conv_101 [Conv] inputs: [518 -> (1, 120, 1, 1)[FLOAT]], [backbone.features.11.block.2.fc2.weight -> (480, 120, 1, 1)[FLOAT]], [backbone.features.11.block.2.fc2.bias -> (480)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 120, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_101 for ONNX node: Conv_101 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 480 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 480, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 519 for ONNX tensor: 519 [02/13/2023-19:50:02] [V] [TRT] Conv_101 [Conv] outputs: [519 -> (1, 480, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_102 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 519 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_102 [HardSigmoid] inputs: [519 -> (1, 480, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_102 for ONNX node: HardSigmoid_102 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 520 for ONNX tensor: 520 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_102 [HardSigmoid] outputs: [520 -> (1, 480, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_103 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 520 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 515 [02/13/2023-19:50:02] [V] [TRT] Mul_103 [Mul] inputs: [520 -> (1, 480, 1, 1)[FLOAT]], [515 -> (1, 480, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_103 for ONNX node: Mul_103 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 521 for ONNX tensor: 521 [02/13/2023-19:50:02] [V] [TRT] Mul_103 [Mul] outputs: [521 -> (1, 480, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_104 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 521 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 920 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 921 [02/13/2023-19:50:02] [V] [TRT] Conv_104 [Conv] inputs: [521 -> (1, 480, 18, 32)[FLOAT]], [920 -> (112, 480, 1, 1)[FLOAT]], [921 -> (112)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 480, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_104 for ONNX node: Conv_104 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 112 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 112, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 919 for ONNX tensor: 919 [02/13/2023-19:50:02] [V] [TRT] Conv_104 [Conv] outputs: [919 -> (1, 112, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_105 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 919 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 923 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 924 [02/13/2023-19:50:02] [V] [TRT] Conv_105 [Conv] inputs: [919 -> (1, 112, 18, 32)[FLOAT]], [923 -> (672, 112, 1, 1)[FLOAT]], [924 -> (672)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 112, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_105 for ONNX node: Conv_105 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 672 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 672, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 922 for ONNX tensor: 922 [02/13/2023-19:50:02] [V] [TRT] Conv_105 [Conv] outputs: [922 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_106 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 922 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_106 [HardSigmoid] inputs: [922 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_106 for ONNX node: HardSigmoid_106 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 526 for ONNX tensor: 526 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_106 [HardSigmoid] outputs: [526 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_107 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 922 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 526 [02/13/2023-19:50:02] [V] [TRT] Mul_107 [Mul] inputs: [922 -> (1, 672, 18, 32)[FLOAT]], [526 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_107 for ONNX node: Mul_107 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 527 for ONNX tensor: 527 [02/13/2023-19:50:02] [V] [TRT] Mul_107 [Mul] outputs: [527 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_108 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 527 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 926 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 927 [02/13/2023-19:50:02] [V] [TRT] Conv_108 [Conv] inputs: [527 -> (1, 672, 18, 32)[FLOAT]], [926 -> (672, 1, 3, 3)[FLOAT]], [927 -> (672)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 672, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_108 for ONNX node: Conv_108 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 672 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 672, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 925 for ONNX tensor: 925 [02/13/2023-19:50:02] [V] [TRT] Conv_108 [Conv] outputs: [925 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_109 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 925 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_109 [HardSigmoid] inputs: [925 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_109 for ONNX node: HardSigmoid_109 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 530 for ONNX tensor: 530 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_109 [HardSigmoid] outputs: [530 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_110 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 925 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 530 [02/13/2023-19:50:02] [V] [TRT] Mul_110 [Mul] inputs: [925 -> (1, 672, 18, 32)[FLOAT]], [530 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_110 for ONNX node: Mul_110 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 531 for ONNX tensor: 531 [02/13/2023-19:50:02] [V] [TRT] Mul_110 [Mul] outputs: [531 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: GlobalAveragePool_111 [GlobalAveragePool] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 531 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_111 [GlobalAveragePool] inputs: [531 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool operators are implemented via Reduce layers rather than Pooling layers [02/13/2023-19:50:02] [V] [TRT] Registering layer: GlobalAveragePool_111 for ONNX node: GlobalAveragePool_111 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 532 for ONNX tensor: 532 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_111 [GlobalAveragePool] outputs: [532 -> (1, 672, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_112 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 532 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.12.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.12.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Conv_112 [Conv] inputs: [532 -> (1, 672, 1, 1)[FLOAT]], [backbone.features.12.block.2.fc1.weight -> (168, 672, 1, 1)[FLOAT]], [backbone.features.12.block.2.fc1.bias -> (168)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 672, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_112 for ONNX node: Conv_112 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 168 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 168, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 533 for ONNX tensor: 533 [02/13/2023-19:50:02] [V] [TRT] Conv_112 [Conv] outputs: [533 -> (1, 168, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_113 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 533 [02/13/2023-19:50:02] [V] [TRT] Relu_113 [Relu] inputs: [533 -> (1, 168, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_113 for ONNX node: Relu_113 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 534 for ONNX tensor: 534 [02/13/2023-19:50:02] [V] [TRT] Relu_113 [Relu] outputs: [534 -> (1, 168, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_114 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 534 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.12.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.12.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Conv_114 [Conv] inputs: [534 -> (1, 168, 1, 1)[FLOAT]], [backbone.features.12.block.2.fc2.weight -> (672, 168, 1, 1)[FLOAT]], [backbone.features.12.block.2.fc2.bias -> (672)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 168, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_114 for ONNX node: Conv_114 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 672 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 672, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 535 for ONNX tensor: 535 [02/13/2023-19:50:02] [V] [TRT] Conv_114 [Conv] outputs: [535 -> (1, 672, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_115 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 535 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_115 [HardSigmoid] inputs: [535 -> (1, 672, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_115 for ONNX node: HardSigmoid_115 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 536 for ONNX tensor: 536 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_115 [HardSigmoid] outputs: [536 -> (1, 672, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_116 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 536 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 531 [02/13/2023-19:50:02] [V] [TRT] Mul_116 [Mul] inputs: [536 -> (1, 672, 1, 1)[FLOAT]], [531 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_116 for ONNX node: Mul_116 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 537 for ONNX tensor: 537 [02/13/2023-19:50:02] [V] [TRT] Mul_116 [Mul] outputs: [537 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_117 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 537 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 929 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 930 [02/13/2023-19:50:02] [V] [TRT] Conv_117 [Conv] inputs: [537 -> (1, 672, 18, 32)[FLOAT]], [929 -> (112, 672, 1, 1)[FLOAT]], [930 -> (112)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 672, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_117 for ONNX node: Conv_117 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 112 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 112, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 928 for ONNX tensor: 928 [02/13/2023-19:50:02] [V] [TRT] Conv_117 [Conv] outputs: [928 -> (1, 112, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_118 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 928 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 919 [02/13/2023-19:50:02] [V] [TRT] Add_118 [Add] inputs: [928 -> (1, 112, 18, 32)[FLOAT]], [919 -> (1, 112, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_118 for ONNX node: Add_118 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 540 for ONNX tensor: 540 [02/13/2023-19:50:02] [V] [TRT] Add_118 [Add] outputs: [540 -> (1, 112, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_119 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 540 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 932 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 933 [02/13/2023-19:50:02] [V] [TRT] Conv_119 [Conv] inputs: [540 -> (1, 112, 18, 32)[FLOAT]], [932 -> (672, 112, 1, 1)[FLOAT]], [933 -> (672)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 112, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_119 for ONNX node: Conv_119 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 672 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 672, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 931 for ONNX tensor: 931 [02/13/2023-19:50:02] [V] [TRT] Conv_119 [Conv] outputs: [931 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_120 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 931 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_120 [HardSigmoid] inputs: [931 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_120 for ONNX node: HardSigmoid_120 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 543 for ONNX tensor: 543 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_120 [HardSigmoid] outputs: [543 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_121 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 931 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 543 [02/13/2023-19:50:02] [V] [TRT] Mul_121 [Mul] inputs: [931 -> (1, 672, 18, 32)[FLOAT]], [543 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_121 for ONNX node: Mul_121 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 544 for ONNX tensor: 544 [02/13/2023-19:50:02] [V] [TRT] Mul_121 [Mul] outputs: [544 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_122 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 544 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 935 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 936 [02/13/2023-19:50:02] [V] [TRT] Conv_122 [Conv] inputs: [544 -> (1, 672, 18, 32)[FLOAT]], [935 -> (672, 1, 5, 5)[FLOAT]], [936 -> (672)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 672, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_122 for ONNX node: Conv_122 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (5, 5), strides: (1, 1), prepadding: (4, 4), postpadding: (4, 4), dilations: (2, 2), numOutputs: 672 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 672, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 934 for ONNX tensor: 934 [02/13/2023-19:50:02] [V] [TRT] Conv_122 [Conv] outputs: [934 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_123 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 934 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_123 [HardSigmoid] inputs: [934 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_123 for ONNX node: HardSigmoid_123 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 547 for ONNX tensor: 547 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_123 [HardSigmoid] outputs: [547 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_124 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 934 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 547 [02/13/2023-19:50:02] [V] [TRT] Mul_124 [Mul] inputs: [934 -> (1, 672, 18, 32)[FLOAT]], [547 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_124 for ONNX node: Mul_124 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 548 for ONNX tensor: 548 [02/13/2023-19:50:02] [V] [TRT] Mul_124 [Mul] outputs: [548 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: GlobalAveragePool_125 [GlobalAveragePool] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 548 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_125 [GlobalAveragePool] inputs: [548 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool operators are implemented via Reduce layers rather than Pooling layers [02/13/2023-19:50:02] [V] [TRT] Registering layer: GlobalAveragePool_125 for ONNX node: GlobalAveragePool_125 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 549 for ONNX tensor: 549 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_125 [GlobalAveragePool] outputs: [549 -> (1, 672, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_126 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 549 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.13.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.13.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Conv_126 [Conv] inputs: [549 -> (1, 672, 1, 1)[FLOAT]], [backbone.features.13.block.2.fc1.weight -> (168, 672, 1, 1)[FLOAT]], [backbone.features.13.block.2.fc1.bias -> (168)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 672, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_126 for ONNX node: Conv_126 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 168 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 168, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 550 for ONNX tensor: 550 [02/13/2023-19:50:02] [V] [TRT] Conv_126 [Conv] outputs: [550 -> (1, 168, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_127 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 550 [02/13/2023-19:50:02] [V] [TRT] Relu_127 [Relu] inputs: [550 -> (1, 168, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_127 for ONNX node: Relu_127 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 551 for ONNX tensor: 551 [02/13/2023-19:50:02] [V] [TRT] Relu_127 [Relu] outputs: [551 -> (1, 168, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_128 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 551 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.13.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.13.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Conv_128 [Conv] inputs: [551 -> (1, 168, 1, 1)[FLOAT]], [backbone.features.13.block.2.fc2.weight -> (672, 168, 1, 1)[FLOAT]], [backbone.features.13.block.2.fc2.bias -> (672)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 168, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_128 for ONNX node: Conv_128 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 672 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 672, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 552 for ONNX tensor: 552 [02/13/2023-19:50:02] [V] [TRT] Conv_128 [Conv] outputs: [552 -> (1, 672, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_129 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 552 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_129 [HardSigmoid] inputs: [552 -> (1, 672, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_129 for ONNX node: HardSigmoid_129 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 553 for ONNX tensor: 553 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_129 [HardSigmoid] outputs: [553 -> (1, 672, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_130 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 553 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 548 [02/13/2023-19:50:02] [V] [TRT] Mul_130 [Mul] inputs: [553 -> (1, 672, 1, 1)[FLOAT]], [548 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_130 for ONNX node: Mul_130 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 554 for ONNX tensor: 554 [02/13/2023-19:50:02] [V] [TRT] Mul_130 [Mul] outputs: [554 -> (1, 672, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_131 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 554 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 938 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 939 [02/13/2023-19:50:02] [V] [TRT] Conv_131 [Conv] inputs: [554 -> (1, 672, 18, 32)[FLOAT]], [938 -> (160, 672, 1, 1)[FLOAT]], [939 -> (160)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 672, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_131 for ONNX node: Conv_131 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 160, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 937 for ONNX tensor: 937 [02/13/2023-19:50:02] [V] [TRT] Conv_131 [Conv] outputs: [937 -> (1, 160, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_132 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 937 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 941 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 942 [02/13/2023-19:50:02] [V] [TRT] Conv_132 [Conv] inputs: [937 -> (1, 160, 18, 32)[FLOAT]], [941 -> (960, 160, 1, 1)[FLOAT]], [942 -> (960)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 160, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_132 for ONNX node: Conv_132 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 960 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 960, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 940 for ONNX tensor: 940 [02/13/2023-19:50:02] [V] [TRT] Conv_132 [Conv] outputs: [940 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_133 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 940 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_133 [HardSigmoid] inputs: [940 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_133 for ONNX node: HardSigmoid_133 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 559 for ONNX tensor: 559 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_133 [HardSigmoid] outputs: [559 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_134 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 940 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 559 [02/13/2023-19:50:02] [V] [TRT] Mul_134 [Mul] inputs: [940 -> (1, 960, 18, 32)[FLOAT]], [559 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_134 for ONNX node: Mul_134 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 560 for ONNX tensor: 560 [02/13/2023-19:50:02] [V] [TRT] Mul_134 [Mul] outputs: [560 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_135 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 560 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 944 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 945 [02/13/2023-19:50:02] [V] [TRT] Conv_135 [Conv] inputs: [560 -> (1, 960, 18, 32)[FLOAT]], [944 -> (960, 1, 5, 5)[FLOAT]], [945 -> (960)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 960, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_135 for ONNX node: Conv_135 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (5, 5), strides: (1, 1), prepadding: (4, 4), postpadding: (4, 4), dilations: (2, 2), numOutputs: 960 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 960, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 943 for ONNX tensor: 943 [02/13/2023-19:50:02] [V] [TRT] Conv_135 [Conv] outputs: [943 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_136 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 943 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_136 [HardSigmoid] inputs: [943 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_136 for ONNX node: HardSigmoid_136 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 563 for ONNX tensor: 563 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_136 [HardSigmoid] outputs: [563 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_137 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 943 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 563 [02/13/2023-19:50:02] [V] [TRT] Mul_137 [Mul] inputs: [943 -> (1, 960, 18, 32)[FLOAT]], [563 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_137 for ONNX node: Mul_137 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 564 for ONNX tensor: 564 [02/13/2023-19:50:02] [V] [TRT] Mul_137 [Mul] outputs: [564 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: GlobalAveragePool_138 [GlobalAveragePool] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 564 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_138 [GlobalAveragePool] inputs: [564 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool operators are implemented via Reduce layers rather than Pooling layers [02/13/2023-19:50:02] [V] [TRT] Registering layer: GlobalAveragePool_138 for ONNX node: GlobalAveragePool_138 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 565 for ONNX tensor: 565 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_138 [GlobalAveragePool] outputs: [565 -> (1, 960, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_139 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 565 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.14.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.14.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Conv_139 [Conv] inputs: [565 -> (1, 960, 1, 1)[FLOAT]], [backbone.features.14.block.2.fc1.weight -> (240, 960, 1, 1)[FLOAT]], [backbone.features.14.block.2.fc1.bias -> (240)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 960, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_139 for ONNX node: Conv_139 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 240 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 240, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 566 for ONNX tensor: 566 [02/13/2023-19:50:02] [V] [TRT] Conv_139 [Conv] outputs: [566 -> (1, 240, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_140 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 566 [02/13/2023-19:50:02] [V] [TRT] Relu_140 [Relu] inputs: [566 -> (1, 240, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_140 for ONNX node: Relu_140 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 567 for ONNX tensor: 567 [02/13/2023-19:50:02] [V] [TRT] Relu_140 [Relu] outputs: [567 -> (1, 240, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_141 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 567 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.14.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.14.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Conv_141 [Conv] inputs: [567 -> (1, 240, 1, 1)[FLOAT]], [backbone.features.14.block.2.fc2.weight -> (960, 240, 1, 1)[FLOAT]], [backbone.features.14.block.2.fc2.bias -> (960)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 240, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_141 for ONNX node: Conv_141 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 960 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 960, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 568 for ONNX tensor: 568 [02/13/2023-19:50:02] [V] [TRT] Conv_141 [Conv] outputs: [568 -> (1, 960, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_142 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 568 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_142 [HardSigmoid] inputs: [568 -> (1, 960, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_142 for ONNX node: HardSigmoid_142 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 569 for ONNX tensor: 569 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_142 [HardSigmoid] outputs: [569 -> (1, 960, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_143 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 569 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 564 [02/13/2023-19:50:02] [V] [TRT] Mul_143 [Mul] inputs: [569 -> (1, 960, 1, 1)[FLOAT]], [564 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_143 for ONNX node: Mul_143 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 570 for ONNX tensor: 570 [02/13/2023-19:50:02] [V] [TRT] Mul_143 [Mul] outputs: [570 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_144 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 570 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 947 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 948 [02/13/2023-19:50:02] [V] [TRT] Conv_144 [Conv] inputs: [570 -> (1, 960, 18, 32)[FLOAT]], [947 -> (160, 960, 1, 1)[FLOAT]], [948 -> (160)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 960, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_144 for ONNX node: Conv_144 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 160, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 946 for ONNX tensor: 946 [02/13/2023-19:50:02] [V] [TRT] Conv_144 [Conv] outputs: [946 -> (1, 160, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_145 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 946 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 937 [02/13/2023-19:50:02] [V] [TRT] Add_145 [Add] inputs: [946 -> (1, 160, 18, 32)[FLOAT]], [937 -> (1, 160, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_145 for ONNX node: Add_145 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 573 for ONNX tensor: 573 [02/13/2023-19:50:02] [V] [TRT] Add_145 [Add] outputs: [573 -> (1, 160, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_146 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 573 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 950 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 951 [02/13/2023-19:50:02] [V] [TRT] Conv_146 [Conv] inputs: [573 -> (1, 160, 18, 32)[FLOAT]], [950 -> (960, 160, 1, 1)[FLOAT]], [951 -> (960)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 160, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_146 for ONNX node: Conv_146 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 960 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 960, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 949 for ONNX tensor: 949 [02/13/2023-19:50:02] [V] [TRT] Conv_146 [Conv] outputs: [949 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_147 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 949 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_147 [HardSigmoid] inputs: [949 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_147 for ONNX node: HardSigmoid_147 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 576 for ONNX tensor: 576 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_147 [HardSigmoid] outputs: [576 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_148 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 949 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 576 [02/13/2023-19:50:02] [V] [TRT] Mul_148 [Mul] inputs: [949 -> (1, 960, 18, 32)[FLOAT]], [576 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_148 for ONNX node: Mul_148 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 577 for ONNX tensor: 577 [02/13/2023-19:50:02] [V] [TRT] Mul_148 [Mul] outputs: [577 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_149 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 577 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 953 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 954 [02/13/2023-19:50:02] [V] [TRT] Conv_149 [Conv] inputs: [577 -> (1, 960, 18, 32)[FLOAT]], [953 -> (960, 1, 5, 5)[FLOAT]], [954 -> (960)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 960, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_149 for ONNX node: Conv_149 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (5, 5), strides: (1, 1), prepadding: (4, 4), postpadding: (4, 4), dilations: (2, 2), numOutputs: 960 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 960, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 952 for ONNX tensor: 952 [02/13/2023-19:50:02] [V] [TRT] Conv_149 [Conv] outputs: [952 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_150 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 952 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_150 [HardSigmoid] inputs: [952 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_150 for ONNX node: HardSigmoid_150 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 580 for ONNX tensor: 580 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_150 [HardSigmoid] outputs: [580 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_151 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 952 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 580 [02/13/2023-19:50:02] [V] [TRT] Mul_151 [Mul] inputs: [952 -> (1, 960, 18, 32)[FLOAT]], [580 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_151 for ONNX node: Mul_151 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 581 for ONNX tensor: 581 [02/13/2023-19:50:02] [V] [TRT] Mul_151 [Mul] outputs: [581 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: GlobalAveragePool_152 [GlobalAveragePool] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 581 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_152 [GlobalAveragePool] inputs: [581 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool operators are implemented via Reduce layers rather than Pooling layers [02/13/2023-19:50:02] [V] [TRT] Registering layer: GlobalAveragePool_152 for ONNX node: GlobalAveragePool_152 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 582 for ONNX tensor: 582 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_152 [GlobalAveragePool] outputs: [582 -> (1, 960, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_153 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 582 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.15.block.2.fc1.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.15.block.2.fc1.bias [02/13/2023-19:50:02] [V] [TRT] Conv_153 [Conv] inputs: [582 -> (1, 960, 1, 1)[FLOAT]], [backbone.features.15.block.2.fc1.weight -> (240, 960, 1, 1)[FLOAT]], [backbone.features.15.block.2.fc1.bias -> (240)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 960, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_153 for ONNX node: Conv_153 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 240 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 240, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 583 for ONNX tensor: 583 [02/13/2023-19:50:02] [V] [TRT] Conv_153 [Conv] outputs: [583 -> (1, 240, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_154 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 583 [02/13/2023-19:50:02] [V] [TRT] Relu_154 [Relu] inputs: [583 -> (1, 240, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_154 for ONNX node: Relu_154 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 584 for ONNX tensor: 584 [02/13/2023-19:50:02] [V] [TRT] Relu_154 [Relu] outputs: [584 -> (1, 240, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_155 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 584 [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.15.block.2.fc2.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: backbone.features.15.block.2.fc2.bias [02/13/2023-19:50:02] [V] [TRT] Conv_155 [Conv] inputs: [584 -> (1, 240, 1, 1)[FLOAT]], [backbone.features.15.block.2.fc2.weight -> (960, 240, 1, 1)[FLOAT]], [backbone.features.15.block.2.fc2.bias -> (960)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 240, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_155 for ONNX node: Conv_155 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 960 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 960, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 585 for ONNX tensor: 585 [02/13/2023-19:50:02] [V] [TRT] Conv_155 [Conv] outputs: [585 -> (1, 960, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_156 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 585 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_156 [HardSigmoid] inputs: [585 -> (1, 960, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_156 for ONNX node: HardSigmoid_156 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 586 for ONNX tensor: 586 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_156 [HardSigmoid] outputs: [586 -> (1, 960, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_157 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 586 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 581 [02/13/2023-19:50:02] [V] [TRT] Mul_157 [Mul] inputs: [586 -> (1, 960, 1, 1)[FLOAT]], [581 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_157 for ONNX node: Mul_157 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 587 for ONNX tensor: 587 [02/13/2023-19:50:02] [V] [TRT] Mul_157 [Mul] outputs: [587 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_158 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 587 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 956 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 957 [02/13/2023-19:50:02] [V] [TRT] Conv_158 [Conv] inputs: [587 -> (1, 960, 18, 32)[FLOAT]], [956 -> (160, 960, 1, 1)[FLOAT]], [957 -> (160)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 960, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_158 for ONNX node: Conv_158 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 160, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 955 for ONNX tensor: 955 [02/13/2023-19:50:02] [V] [TRT] Conv_158 [Conv] outputs: [955 -> (1, 160, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_159 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 955 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 573 [02/13/2023-19:50:02] [V] [TRT] Add_159 [Add] inputs: [955 -> (1, 160, 18, 32)[FLOAT]], [573 -> (1, 160, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_159 for ONNX node: Add_159 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 590 for ONNX tensor: 590 [02/13/2023-19:50:02] [V] [TRT] Add_159 [Add] outputs: [590 -> (1, 160, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_160 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 590 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 959 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 960 [02/13/2023-19:50:02] [V] [TRT] Conv_160 [Conv] inputs: [590 -> (1, 160, 18, 32)[FLOAT]], [959 -> (960, 160, 1, 1)[FLOAT]], [960 -> (960)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 160, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_160 for ONNX node: Conv_160 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 960 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 960, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 958 for ONNX tensor: 958 [02/13/2023-19:50:02] [V] [TRT] Conv_160 [Conv] outputs: [958 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: HardSigmoid_161 [HardSigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 958 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_161 [HardSigmoid] inputs: [958 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: HardSigmoid_161 for ONNX node: HardSigmoid_161 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 593 for ONNX tensor: 593 [02/13/2023-19:50:02] [V] [TRT] HardSigmoid_161 [HardSigmoid] outputs: [593 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_162 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 958 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 593 [02/13/2023-19:50:02] [V] [TRT] Mul_162 [Mul] inputs: [958 -> (1, 960, 18, 32)[FLOAT]], [593 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_162 for ONNX node: Mul_162 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 594 for ONNX tensor: 594 [02/13/2023-19:50:02] [V] [TRT] Mul_162 [Mul] outputs: [594 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_163 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 594 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 962 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 963 [02/13/2023-19:50:02] [V] [TRT] Conv_163 [Conv] inputs: [594 -> (1, 960, 18, 32)[FLOAT]], [962 -> (128, 960, 1, 1)[FLOAT]], [963 -> (128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 960, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_163 for ONNX node: Conv_163 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 128, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 961 for ONNX tensor: 961 [02/13/2023-19:50:02] [V] [TRT] Conv_163 [Conv] outputs: [961 -> (1, 128, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_164 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 961 [02/13/2023-19:50:02] [V] [TRT] Relu_164 [Relu] inputs: [961 -> (1, 128, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_164 for ONNX node: Relu_164 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 597 for ONNX tensor: 597 [02/13/2023-19:50:02] [V] [TRT] Relu_164 [Relu] outputs: [597 -> (1, 128, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: GlobalAveragePool_165 [GlobalAveragePool] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 594 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_165 [GlobalAveragePool] inputs: [594 -> (1, 960, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool operators are implemented via Reduce layers rather than Pooling layers [02/13/2023-19:50:02] [V] [TRT] Registering layer: GlobalAveragePool_165 for ONNX node: GlobalAveragePool_165 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 598 for ONNX tensor: 598 [02/13/2023-19:50:02] [V] [TRT] GlobalAveragePool_165 [GlobalAveragePool] outputs: [598 -> (1, 960, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_166 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 598 [02/13/2023-19:50:02] [V] [TRT] Searching for input: aspp.aspp2.1.weight [02/13/2023-19:50:02] [V] [TRT] Conv_166 [Conv] inputs: [598 -> (1, 960, 1, 1)[FLOAT]], [aspp.aspp2.1.weight -> (128, 960, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 960, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_166 for ONNX node: Conv_166 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 128, 1, 1) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 599 for ONNX tensor: 599 [02/13/2023-19:50:02] [V] [TRT] Conv_166 [Conv] outputs: [599 -> (1, 128, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Sigmoid_167 [Sigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 599 [02/13/2023-19:50:02] [V] [TRT] Sigmoid_167 [Sigmoid] inputs: [599 -> (1, 128, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Sigmoid_167 for ONNX node: Sigmoid_167 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 600 for ONNX tensor: 600 [02/13/2023-19:50:02] [V] [TRT] Sigmoid_167 [Sigmoid] outputs: [600 -> (1, 128, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_168 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 597 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 600 [02/13/2023-19:50:02] [V] [TRT] Mul_168 [Mul] inputs: [597 -> (1, 128, 18, 32)[FLOAT]], [600 -> (1, 128, 1, 1)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_168 for ONNX node: Mul_168 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 601 for ONNX tensor: 601 [02/13/2023-19:50:02] [V] [TRT] Mul_168 [Mul] outputs: [601 -> (1, 128, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: AveragePool_169 [AveragePool] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 389 [02/13/2023-19:50:02] [V] [TRT] AveragePool_169 [AveragePool] inputs: [389 -> (1, 3, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: AveragePool_169 for ONNX node: AveragePool_169 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 602 for ONNX tensor: 602 [02/13/2023-19:50:02] [V] [TRT] AveragePool_169 [AveragePool] outputs: [602 -> (1, 3, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: AveragePool_170 [AveragePool] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 602 [02/13/2023-19:50:02] [V] [TRT] AveragePool_170 [AveragePool] inputs: [602 -> (1, 3, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: AveragePool_170 for ONNX node: AveragePool_170 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 603 for ONNX tensor: 603 [02/13/2023-19:50:02] [V] [TRT] AveragePool_170 [AveragePool] outputs: [603 -> (1, 3, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: AveragePool_171 [AveragePool] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 603 [02/13/2023-19:50:02] [V] [TRT] AveragePool_171 [AveragePool] inputs: [603 -> (1, 3, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: AveragePool_171 for ONNX node: AveragePool_171 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 604 for ONNX tensor: 604 [02/13/2023-19:50:02] [V] [TRT] AveragePool_171 [AveragePool] outputs: [604 -> (1, 3, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Split_172 [Split] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 601 [02/13/2023-19:50:02] [V] [TRT] Split_172 [Split] inputs: [601 -> (1, 128, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_172 for ONNX node: Split_172 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_172_0 for ONNX node: Split_172 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 605 for ONNX tensor: 605 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 606 for ONNX tensor: 606 [02/13/2023-19:50:02] [V] [TRT] Split_172 [Split] outputs: [605 -> (1, 64, 18, 32)[FLOAT]], [606 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Shape_173 [Shape] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 606 [02/13/2023-19:50:02] [V] [TRT] Shape_173 [Shape] inputs: [606 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Shape_173 for ONNX node: Shape_173 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 607 for ONNX tensor: 607 [02/13/2023-19:50:02] [V] [TRT] Shape_173 [Shape] outputs: [607 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Expand_174 [Expand] [02/13/2023-19:50:02] [V] [TRT] Searching for input: r4i [02/13/2023-19:50:02] [V] [TRT] Searching for input: 607 [02/13/2023-19:50:02] [V] [TRT] Expand_174 [Expand] inputs: [r4i -> (1, 1, 1, 1)[FLOAT]], [607 -> (4)[INT32]], [02/13/2023-19:50:02] [W] [TRT] onnx2trt_utils.cpp:367: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [02/13/2023-19:50:02] [V] [TRT] Registering layer: Expand_174 for ONNX node: Expand_174 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 608 for ONNX tensor: 608 [02/13/2023-19:50:02] [V] [TRT] Expand_174 [Expand] outputs: [608 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_175 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 606 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 608 [02/13/2023-19:50:02] [V] [TRT] Concat_175 [Concat] inputs: [606 -> (1, 64, 18, 32)[FLOAT]], [608 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_175 for ONNX node: Concat_175 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 609 for ONNX tensor: 609 [02/13/2023-19:50:02] [V] [TRT] Concat_175 [Concat] outputs: [609 -> (1, 128, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_176 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 609 [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode4.gru.ih.0.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode4.gru.ih.0.bias [02/13/2023-19:50:02] [V] [TRT] Conv_176 [Conv] inputs: [609 -> (1, 128, 18, 32)[FLOAT]], [decoder.decode4.gru.ih.0.weight -> (128, 128, 3, 3)[FLOAT]], [decoder.decode4.gru.ih.0.bias -> (128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 128, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_176 for ONNX node: Conv_176 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 128, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 610 for ONNX tensor: 610 [02/13/2023-19:50:02] [V] [TRT] Conv_176 [Conv] outputs: [610 -> (1, 128, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Sigmoid_177 [Sigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 610 [02/13/2023-19:50:02] [V] [TRT] Sigmoid_177 [Sigmoid] inputs: [610 -> (1, 128, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Sigmoid_177 for ONNX node: Sigmoid_177 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 611 for ONNX tensor: 611 [02/13/2023-19:50:02] [V] [TRT] Sigmoid_177 [Sigmoid] outputs: [611 -> (1, 128, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Split_178 [Split] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 611 [02/13/2023-19:50:02] [V] [TRT] Split_178 [Split] inputs: [611 -> (1, 128, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_178 for ONNX node: Split_178 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_178_2 for ONNX node: Split_178 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 612 for ONNX tensor: 612 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 613 for ONNX tensor: 613 [02/13/2023-19:50:02] [V] [TRT] Split_178 [Split] outputs: [612 -> (1, 64, 18, 32)[FLOAT]], [613 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_179 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 612 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 608 [02/13/2023-19:50:02] [V] [TRT] Mul_179 [Mul] inputs: [612 -> (1, 64, 18, 32)[FLOAT]], [608 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_179 for ONNX node: Mul_179 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 614 for ONNX tensor: 614 [02/13/2023-19:50:02] [V] [TRT] Mul_179 [Mul] outputs: [614 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_180 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 606 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 614 [02/13/2023-19:50:02] [V] [TRT] Concat_180 [Concat] inputs: [606 -> (1, 64, 18, 32)[FLOAT]], [614 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_180 for ONNX node: Concat_180 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 615 for ONNX tensor: 615 [02/13/2023-19:50:02] [V] [TRT] Concat_180 [Concat] outputs: [615 -> (1, 128, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_181 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 615 [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode4.gru.hh.0.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode4.gru.hh.0.bias [02/13/2023-19:50:02] [V] [TRT] Conv_181 [Conv] inputs: [615 -> (1, 128, 18, 32)[FLOAT]], [decoder.decode4.gru.hh.0.weight -> (64, 128, 3, 3)[FLOAT]], [decoder.decode4.gru.hh.0.bias -> (64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 128, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_181 for ONNX node: Conv_181 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 64, 18, 32) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 616 for ONNX tensor: 616 [02/13/2023-19:50:02] [V] [TRT] Conv_181 [Conv] outputs: [616 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Tanh_182 [Tanh] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 616 [02/13/2023-19:50:02] [V] [TRT] Tanh_182 [Tanh] inputs: [616 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Tanh_182 for ONNX node: Tanh_182 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 617 for ONNX tensor: 617 [02/13/2023-19:50:02] [V] [TRT] Tanh_182 [Tanh] outputs: [617 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Sub_184 [Sub] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 990 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 613 [02/13/2023-19:50:02] [V] [TRT] Sub_184 [Sub] inputs: [990 -> ()[FLOAT]], [613 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: 990 for ONNX node: 990 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Sub_184 for ONNX node: Sub_184 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 619 for ONNX tensor: 619 [02/13/2023-19:50:02] [V] [TRT] Sub_184 [Sub] outputs: [619 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_185 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 619 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 608 [02/13/2023-19:50:02] [V] [TRT] Mul_185 [Mul] inputs: [619 -> (1, 64, 18, 32)[FLOAT]], [608 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_185 for ONNX node: Mul_185 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 620 for ONNX tensor: 620 [02/13/2023-19:50:02] [V] [TRT] Mul_185 [Mul] outputs: [620 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_186 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 613 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 617 [02/13/2023-19:50:02] [V] [TRT] Mul_186 [Mul] inputs: [613 -> (1, 64, 18, 32)[FLOAT]], [617 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_186 for ONNX node: Mul_186 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 621 for ONNX tensor: 621 [02/13/2023-19:50:02] [V] [TRT] Mul_186 [Mul] outputs: [621 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_187 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 620 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 621 [02/13/2023-19:50:02] [V] [TRT] Add_187 [Add] inputs: [620 -> (1, 64, 18, 32)[FLOAT]], [621 -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_187 for ONNX node: Add_187 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: r4o_3 for ONNX tensor: r4o [02/13/2023-19:50:02] [V] [TRT] Add_187 [Add] outputs: [r4o -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_188 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 605 [02/13/2023-19:50:02] [V] [TRT] Searching for input: r4o [02/13/2023-19:50:02] [V] [TRT] Concat_188 [Concat] inputs: [605 -> (1, 64, 18, 32)[FLOAT]], [r4o -> (1, 64, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_188 for ONNX node: Concat_188 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 623 for ONNX tensor: 623 [02/13/2023-19:50:02] [V] [TRT] Concat_188 [Concat] outputs: [623 -> (1, 128, 18, 32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Resize_190 [Resize] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 623 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 386 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 985 [02/13/2023-19:50:02] [V] [TRT] Resize_190 [Resize] inputs: [623 -> (1, 128, 18, 32)[FLOAT]], [386 -> (0)[FLOAT]], [985 -> (4)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Resize_190 for ONNX node: Resize_190 [02/13/2023-19:50:02] [V] [TRT] Running resize layer with: Transformation mode: pytorch_half_pixel Resize mode: linear [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 628 for ONNX tensor: 628 [02/13/2023-19:50:02] [V] [TRT] Resize_190 [Resize] outputs: [628 -> (1, 128, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Shape_191 [Shape] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 604 [02/13/2023-19:50:02] [V] [TRT] Shape_191 [Shape] inputs: [604 -> (1, 3, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Shape_191 for ONNX node: Shape_191 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 629 for ONNX tensor: 629 [02/13/2023-19:50:02] [V] [TRT] Shape_191 [Shape] outputs: [629 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Slice_195 [Slice] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 629 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 630 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 631 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 632 [02/13/2023-19:50:02] [V] [TRT] Slice_195 [Slice] inputs: [629 -> (4)[INT32]], [630 -> (1)[INT32]], [631 -> (1)[INT32]], [632 -> (1)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Slice_195 for ONNX node: Slice_195 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 633 for ONNX tensor: 633 [02/13/2023-19:50:02] [V] [TRT] Slice_195 [Slice] outputs: [633 -> (2)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Slice_198 [Slice] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 628 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 634 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 633 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 635 [02/13/2023-19:50:02] [V] [TRT] Slice_198 [Slice] inputs: [628 -> (1, 128, 36, 64)[FLOAT]], [634 -> (2)[INT32]], [633 -> (2)[INT32]], [635 -> (2)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Slice_198 for ONNX node: Slice_198 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 636 for ONNX tensor: 636 [02/13/2023-19:50:02] [V] [TRT] Slice_198 [Slice] outputs: [636 -> (1, 128, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_199 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 636 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 464 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 604 [02/13/2023-19:50:02] [V] [TRT] Concat_199 [Concat] inputs: [636 -> (1, 128, 36, 64)[FLOAT]], [464 -> (1, 40, 36, 64)[FLOAT]], [604 -> (1, 3, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_199 for ONNX node: Concat_199 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 637 for ONNX tensor: 637 [02/13/2023-19:50:02] [V] [TRT] Concat_199 [Concat] outputs: [637 -> (1, 171, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_200 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 637 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 965 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 966 [02/13/2023-19:50:02] [V] [TRT] Conv_200 [Conv] inputs: [637 -> (1, 171, 36, 64)[FLOAT]], [965 -> (80, 171, 3, 3)[FLOAT]], [966 -> (80)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 171, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_200 for ONNX node: Conv_200 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 80 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 80, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 964 for ONNX tensor: 964 [02/13/2023-19:50:02] [V] [TRT] Conv_200 [Conv] outputs: [964 -> (1, 80, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_201 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 964 [02/13/2023-19:50:02] [V] [TRT] Relu_201 [Relu] inputs: [964 -> (1, 80, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_201 for ONNX node: Relu_201 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 640 for ONNX tensor: 640 [02/13/2023-19:50:02] [V] [TRT] Relu_201 [Relu] outputs: [640 -> (1, 80, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Split_202 [Split] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 640 [02/13/2023-19:50:02] [V] [TRT] Split_202 [Split] inputs: [640 -> (1, 80, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_202 for ONNX node: Split_202 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_202_10 for ONNX node: Split_202 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 641 for ONNX tensor: 641 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 642 for ONNX tensor: 642 [02/13/2023-19:50:02] [V] [TRT] Split_202 [Split] outputs: [641 -> (1, 40, 36, 64)[FLOAT]], [642 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Shape_203 [Shape] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 642 [02/13/2023-19:50:02] [V] [TRT] Shape_203 [Shape] inputs: [642 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Shape_203 for ONNX node: Shape_203 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 643 for ONNX tensor: 643 [02/13/2023-19:50:02] [V] [TRT] Shape_203 [Shape] outputs: [643 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Expand_204 [Expand] [02/13/2023-19:50:02] [V] [TRT] Searching for input: r3i [02/13/2023-19:50:02] [V] [TRT] Searching for input: 643 [02/13/2023-19:50:02] [V] [TRT] Expand_204 [Expand] inputs: [r3i -> (1, 1, 1, 1)[FLOAT]], [643 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Expand_204 for ONNX node: Expand_204 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 644 for ONNX tensor: 644 [02/13/2023-19:50:02] [V] [TRT] Expand_204 [Expand] outputs: [644 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_205 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 642 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 644 [02/13/2023-19:50:02] [V] [TRT] Concat_205 [Concat] inputs: [642 -> (1, 40, 36, 64)[FLOAT]], [644 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_205 for ONNX node: Concat_205 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 645 for ONNX tensor: 645 [02/13/2023-19:50:02] [V] [TRT] Concat_205 [Concat] outputs: [645 -> (1, 80, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_206 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 645 [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode3.gru.ih.0.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode3.gru.ih.0.bias [02/13/2023-19:50:02] [V] [TRT] Conv_206 [Conv] inputs: [645 -> (1, 80, 36, 64)[FLOAT]], [decoder.decode3.gru.ih.0.weight -> (80, 80, 3, 3)[FLOAT]], [decoder.decode3.gru.ih.0.bias -> (80)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 80, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_206 for ONNX node: Conv_206 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 80 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 80, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 646 for ONNX tensor: 646 [02/13/2023-19:50:02] [V] [TRT] Conv_206 [Conv] outputs: [646 -> (1, 80, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Sigmoid_207 [Sigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 646 [02/13/2023-19:50:02] [V] [TRT] Sigmoid_207 [Sigmoid] inputs: [646 -> (1, 80, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Sigmoid_207 for ONNX node: Sigmoid_207 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 647 for ONNX tensor: 647 [02/13/2023-19:50:02] [V] [TRT] Sigmoid_207 [Sigmoid] outputs: [647 -> (1, 80, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Split_208 [Split] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 647 [02/13/2023-19:50:02] [V] [TRT] Split_208 [Split] inputs: [647 -> (1, 80, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_208 for ONNX node: Split_208 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_208_13 for ONNX node: Split_208 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 648 for ONNX tensor: 648 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 649 for ONNX tensor: 649 [02/13/2023-19:50:02] [V] [TRT] Split_208 [Split] outputs: [648 -> (1, 40, 36, 64)[FLOAT]], [649 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_209 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 648 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 644 [02/13/2023-19:50:02] [V] [TRT] Mul_209 [Mul] inputs: [648 -> (1, 40, 36, 64)[FLOAT]], [644 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_209 for ONNX node: Mul_209 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 650 for ONNX tensor: 650 [02/13/2023-19:50:02] [V] [TRT] Mul_209 [Mul] outputs: [650 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_210 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 642 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 650 [02/13/2023-19:50:02] [V] [TRT] Concat_210 [Concat] inputs: [642 -> (1, 40, 36, 64)[FLOAT]], [650 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_210 for ONNX node: Concat_210 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 651 for ONNX tensor: 651 [02/13/2023-19:50:02] [V] [TRT] Concat_210 [Concat] outputs: [651 -> (1, 80, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_211 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 651 [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode3.gru.hh.0.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode3.gru.hh.0.bias [02/13/2023-19:50:02] [V] [TRT] Conv_211 [Conv] inputs: [651 -> (1, 80, 36, 64)[FLOAT]], [decoder.decode3.gru.hh.0.weight -> (40, 80, 3, 3)[FLOAT]], [decoder.decode3.gru.hh.0.bias -> (40)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 80, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_211 for ONNX node: Conv_211 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 40 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 40, 36, 64) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 652 for ONNX tensor: 652 [02/13/2023-19:50:02] [V] [TRT] Conv_211 [Conv] outputs: [652 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Tanh_212 [Tanh] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 652 [02/13/2023-19:50:02] [V] [TRT] Tanh_212 [Tanh] inputs: [652 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Tanh_212 for ONNX node: Tanh_212 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 653 for ONNX tensor: 653 [02/13/2023-19:50:02] [V] [TRT] Tanh_212 [Tanh] outputs: [653 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Sub_214 [Sub] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 990 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 649 [02/13/2023-19:50:02] [V] [TRT] Sub_214 [Sub] inputs: [990 -> ()[FLOAT]], [649 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Sub_214 for ONNX node: Sub_214 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 655 for ONNX tensor: 655 [02/13/2023-19:50:02] [V] [TRT] Sub_214 [Sub] outputs: [655 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_215 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 655 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 644 [02/13/2023-19:50:02] [V] [TRT] Mul_215 [Mul] inputs: [655 -> (1, 40, 36, 64)[FLOAT]], [644 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_215 for ONNX node: Mul_215 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 656 for ONNX tensor: 656 [02/13/2023-19:50:02] [V] [TRT] Mul_215 [Mul] outputs: [656 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_216 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 649 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 653 [02/13/2023-19:50:02] [V] [TRT] Mul_216 [Mul] inputs: [649 -> (1, 40, 36, 64)[FLOAT]], [653 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_216 for ONNX node: Mul_216 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 657 for ONNX tensor: 657 [02/13/2023-19:50:02] [V] [TRT] Mul_216 [Mul] outputs: [657 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_217 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 656 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 657 [02/13/2023-19:50:02] [V] [TRT] Add_217 [Add] inputs: [656 -> (1, 40, 36, 64)[FLOAT]], [657 -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_217 for ONNX node: Add_217 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: r3o_14 for ONNX tensor: r3o [02/13/2023-19:50:02] [V] [TRT] Add_217 [Add] outputs: [r3o -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_218 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 641 [02/13/2023-19:50:02] [V] [TRT] Searching for input: r3o [02/13/2023-19:50:02] [V] [TRT] Concat_218 [Concat] inputs: [641 -> (1, 40, 36, 64)[FLOAT]], [r3o -> (1, 40, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_218 for ONNX node: Concat_218 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 659 for ONNX tensor: 659 [02/13/2023-19:50:02] [V] [TRT] Concat_218 [Concat] outputs: [659 -> (1, 80, 36, 64)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Resize_220 [Resize] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 659 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 386 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 985 [02/13/2023-19:50:02] [V] [TRT] Resize_220 [Resize] inputs: [659 -> (1, 80, 36, 64)[FLOAT]], [386 -> (0)[FLOAT]], [985 -> (4)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Resize_220 for ONNX node: Resize_220 [02/13/2023-19:50:02] [V] [TRT] Running resize layer with: Transformation mode: pytorch_half_pixel Resize mode: linear [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 664 for ONNX tensor: 664 [02/13/2023-19:50:02] [V] [TRT] Resize_220 [Resize] outputs: [664 -> (1, 80, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Shape_221 [Shape] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 603 [02/13/2023-19:50:02] [V] [TRT] Shape_221 [Shape] inputs: [603 -> (1, 3, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Shape_221 for ONNX node: Shape_221 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 665 for ONNX tensor: 665 [02/13/2023-19:50:02] [V] [TRT] Shape_221 [Shape] outputs: [665 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Slice_225 [Slice] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 665 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 630 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 631 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 632 [02/13/2023-19:50:02] [V] [TRT] Slice_225 [Slice] inputs: [665 -> (4)[INT32]], [630 -> (1)[INT32]], [631 -> (1)[INT32]], [632 -> (1)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Slice_225 for ONNX node: Slice_225 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 669 for ONNX tensor: 669 [02/13/2023-19:50:02] [V] [TRT] Slice_225 [Slice] outputs: [669 -> (2)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Slice_228 [Slice] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 664 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 634 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 669 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 635 [02/13/2023-19:50:02] [V] [TRT] Slice_228 [Slice] inputs: [664 -> (1, 80, 72, 128)[FLOAT]], [634 -> (2)[INT32]], [669 -> (2)[INT32]], [635 -> (2)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Slice_228 for ONNX node: Slice_228 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 672 for ONNX tensor: 672 [02/13/2023-19:50:02] [V] [TRT] Slice_228 [Slice] outputs: [672 -> (1, 80, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_229 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 672 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 420 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 603 [02/13/2023-19:50:02] [V] [TRT] Concat_229 [Concat] inputs: [672 -> (1, 80, 72, 128)[FLOAT]], [420 -> (1, 24, 72, 128)[FLOAT]], [603 -> (1, 3, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_229 for ONNX node: Concat_229 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 673 for ONNX tensor: 673 [02/13/2023-19:50:02] [V] [TRT] Concat_229 [Concat] outputs: [673 -> (1, 107, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_230 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 673 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 968 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 969 [02/13/2023-19:50:02] [V] [TRT] Conv_230 [Conv] inputs: [673 -> (1, 107, 72, 128)[FLOAT]], [968 -> (40, 107, 3, 3)[FLOAT]], [969 -> (40)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 107, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_230 for ONNX node: Conv_230 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 40 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 40, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 967 for ONNX tensor: 967 [02/13/2023-19:50:02] [V] [TRT] Conv_230 [Conv] outputs: [967 -> (1, 40, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_231 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 967 [02/13/2023-19:50:02] [V] [TRT] Relu_231 [Relu] inputs: [967 -> (1, 40, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_231 for ONNX node: Relu_231 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 676 for ONNX tensor: 676 [02/13/2023-19:50:02] [V] [TRT] Relu_231 [Relu] outputs: [676 -> (1, 40, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Split_232 [Split] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 676 [02/13/2023-19:50:02] [V] [TRT] Split_232 [Split] inputs: [676 -> (1, 40, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_232 for ONNX node: Split_232 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_232_21 for ONNX node: Split_232 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 677 for ONNX tensor: 677 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 678 for ONNX tensor: 678 [02/13/2023-19:50:02] [V] [TRT] Split_232 [Split] outputs: [677 -> (1, 20, 72, 128)[FLOAT]], [678 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Shape_233 [Shape] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 678 [02/13/2023-19:50:02] [V] [TRT] Shape_233 [Shape] inputs: [678 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Shape_233 for ONNX node: Shape_233 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 679 for ONNX tensor: 679 [02/13/2023-19:50:02] [V] [TRT] Shape_233 [Shape] outputs: [679 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Expand_234 [Expand] [02/13/2023-19:50:02] [V] [TRT] Searching for input: r2i [02/13/2023-19:50:02] [V] [TRT] Searching for input: 679 [02/13/2023-19:50:02] [V] [TRT] Expand_234 [Expand] inputs: [r2i -> (1, 1, 1, 1)[FLOAT]], [679 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Expand_234 for ONNX node: Expand_234 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 680 for ONNX tensor: 680 [02/13/2023-19:50:02] [V] [TRT] Expand_234 [Expand] outputs: [680 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_235 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 678 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 680 [02/13/2023-19:50:02] [V] [TRT] Concat_235 [Concat] inputs: [678 -> (1, 20, 72, 128)[FLOAT]], [680 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_235 for ONNX node: Concat_235 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 681 for ONNX tensor: 681 [02/13/2023-19:50:02] [V] [TRT] Concat_235 [Concat] outputs: [681 -> (1, 40, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_236 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 681 [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode2.gru.ih.0.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode2.gru.ih.0.bias [02/13/2023-19:50:02] [V] [TRT] Conv_236 [Conv] inputs: [681 -> (1, 40, 72, 128)[FLOAT]], [decoder.decode2.gru.ih.0.weight -> (40, 40, 3, 3)[FLOAT]], [decoder.decode2.gru.ih.0.bias -> (40)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 40, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_236 for ONNX node: Conv_236 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 40 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 40, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 682 for ONNX tensor: 682 [02/13/2023-19:50:02] [V] [TRT] Conv_236 [Conv] outputs: [682 -> (1, 40, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Sigmoid_237 [Sigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 682 [02/13/2023-19:50:02] [V] [TRT] Sigmoid_237 [Sigmoid] inputs: [682 -> (1, 40, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Sigmoid_237 for ONNX node: Sigmoid_237 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 683 for ONNX tensor: 683 [02/13/2023-19:50:02] [V] [TRT] Sigmoid_237 [Sigmoid] outputs: [683 -> (1, 40, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Split_238 [Split] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 683 [02/13/2023-19:50:02] [V] [TRT] Split_238 [Split] inputs: [683 -> (1, 40, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_238 for ONNX node: Split_238 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_238_24 for ONNX node: Split_238 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 684 for ONNX tensor: 684 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 685 for ONNX tensor: 685 [02/13/2023-19:50:02] [V] [TRT] Split_238 [Split] outputs: [684 -> (1, 20, 72, 128)[FLOAT]], [685 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_239 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 684 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 680 [02/13/2023-19:50:02] [V] [TRT] Mul_239 [Mul] inputs: [684 -> (1, 20, 72, 128)[FLOAT]], [680 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_239 for ONNX node: Mul_239 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 686 for ONNX tensor: 686 [02/13/2023-19:50:02] [V] [TRT] Mul_239 [Mul] outputs: [686 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_240 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 678 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 686 [02/13/2023-19:50:02] [V] [TRT] Concat_240 [Concat] inputs: [678 -> (1, 20, 72, 128)[FLOAT]], [686 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_240 for ONNX node: Concat_240 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 687 for ONNX tensor: 687 [02/13/2023-19:50:02] [V] [TRT] Concat_240 [Concat] outputs: [687 -> (1, 40, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_241 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 687 [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode2.gru.hh.0.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode2.gru.hh.0.bias [02/13/2023-19:50:02] [V] [TRT] Conv_241 [Conv] inputs: [687 -> (1, 40, 72, 128)[FLOAT]], [decoder.decode2.gru.hh.0.weight -> (20, 40, 3, 3)[FLOAT]], [decoder.decode2.gru.hh.0.bias -> (20)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 40, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_241 for ONNX node: Conv_241 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 20 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 20, 72, 128) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 688 for ONNX tensor: 688 [02/13/2023-19:50:02] [V] [TRT] Conv_241 [Conv] outputs: [688 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Tanh_242 [Tanh] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 688 [02/13/2023-19:50:02] [V] [TRT] Tanh_242 [Tanh] inputs: [688 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Tanh_242 for ONNX node: Tanh_242 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 689 for ONNX tensor: 689 [02/13/2023-19:50:02] [V] [TRT] Tanh_242 [Tanh] outputs: [689 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Sub_244 [Sub] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 990 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 685 [02/13/2023-19:50:02] [V] [TRT] Sub_244 [Sub] inputs: [990 -> ()[FLOAT]], [685 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Sub_244 for ONNX node: Sub_244 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 691 for ONNX tensor: 691 [02/13/2023-19:50:02] [V] [TRT] Sub_244 [Sub] outputs: [691 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_245 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 691 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 680 [02/13/2023-19:50:02] [V] [TRT] Mul_245 [Mul] inputs: [691 -> (1, 20, 72, 128)[FLOAT]], [680 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_245 for ONNX node: Mul_245 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 692 for ONNX tensor: 692 [02/13/2023-19:50:02] [V] [TRT] Mul_245 [Mul] outputs: [692 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_246 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 685 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 689 [02/13/2023-19:50:02] [V] [TRT] Mul_246 [Mul] inputs: [685 -> (1, 20, 72, 128)[FLOAT]], [689 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_246 for ONNX node: Mul_246 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 693 for ONNX tensor: 693 [02/13/2023-19:50:02] [V] [TRT] Mul_246 [Mul] outputs: [693 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_247 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 692 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 693 [02/13/2023-19:50:02] [V] [TRT] Add_247 [Add] inputs: [692 -> (1, 20, 72, 128)[FLOAT]], [693 -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_247 for ONNX node: Add_247 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: r2o_25 for ONNX tensor: r2o [02/13/2023-19:50:02] [V] [TRT] Add_247 [Add] outputs: [r2o -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_248 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 677 [02/13/2023-19:50:02] [V] [TRT] Searching for input: r2o [02/13/2023-19:50:02] [V] [TRT] Concat_248 [Concat] inputs: [677 -> (1, 20, 72, 128)[FLOAT]], [r2o -> (1, 20, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_248 for ONNX node: Concat_248 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 695 for ONNX tensor: 695 [02/13/2023-19:50:02] [V] [TRT] Concat_248 [Concat] outputs: [695 -> (1, 40, 72, 128)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Resize_250 [Resize] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 695 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 386 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 985 [02/13/2023-19:50:02] [V] [TRT] Resize_250 [Resize] inputs: [695 -> (1, 40, 72, 128)[FLOAT]], [386 -> (0)[FLOAT]], [985 -> (4)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Resize_250 for ONNX node: Resize_250 [02/13/2023-19:50:02] [V] [TRT] Running resize layer with: Transformation mode: pytorch_half_pixel Resize mode: linear [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 700 for ONNX tensor: 700 [02/13/2023-19:50:02] [V] [TRT] Resize_250 [Resize] outputs: [700 -> (1, 40, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Shape_251 [Shape] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 602 [02/13/2023-19:50:02] [V] [TRT] Shape_251 [Shape] inputs: [602 -> (1, 3, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Shape_251 for ONNX node: Shape_251 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 701 for ONNX tensor: 701 [02/13/2023-19:50:02] [V] [TRT] Shape_251 [Shape] outputs: [701 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Slice_255 [Slice] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 701 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 630 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 631 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 632 [02/13/2023-19:50:02] [V] [TRT] Slice_255 [Slice] inputs: [701 -> (4)[INT32]], [630 -> (1)[INT32]], [631 -> (1)[INT32]], [632 -> (1)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Slice_255 for ONNX node: Slice_255 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 705 for ONNX tensor: 705 [02/13/2023-19:50:02] [V] [TRT] Slice_255 [Slice] outputs: [705 -> (2)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Slice_258 [Slice] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 700 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 634 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 705 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 635 [02/13/2023-19:50:02] [V] [TRT] Slice_258 [Slice] inputs: [700 -> (1, 40, 144, 256)[FLOAT]], [634 -> (2)[INT32]], [705 -> (2)[INT32]], [635 -> (2)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Slice_258 for ONNX node: Slice_258 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 708 for ONNX tensor: 708 [02/13/2023-19:50:02] [V] [TRT] Slice_258 [Slice] outputs: [708 -> (1, 40, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_259 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 708 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 403 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 602 [02/13/2023-19:50:02] [V] [TRT] Concat_259 [Concat] inputs: [708 -> (1, 40, 144, 256)[FLOAT]], [403 -> (1, 16, 144, 256)[FLOAT]], [602 -> (1, 3, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_259 for ONNX node: Concat_259 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 709 for ONNX tensor: 709 [02/13/2023-19:50:02] [V] [TRT] Concat_259 [Concat] outputs: [709 -> (1, 59, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_260 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 709 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 971 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 972 [02/13/2023-19:50:02] [V] [TRT] Conv_260 [Conv] inputs: [709 -> (1, 59, 144, 256)[FLOAT]], [971 -> (32, 59, 3, 3)[FLOAT]], [972 -> (32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 59, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_260 for ONNX node: Conv_260 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 32, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 970 for ONNX tensor: 970 [02/13/2023-19:50:02] [V] [TRT] Conv_260 [Conv] outputs: [970 -> (1, 32, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_261 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 970 [02/13/2023-19:50:02] [V] [TRT] Relu_261 [Relu] inputs: [970 -> (1, 32, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_261 for ONNX node: Relu_261 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 712 for ONNX tensor: 712 [02/13/2023-19:50:02] [V] [TRT] Relu_261 [Relu] outputs: [712 -> (1, 32, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Split_262 [Split] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 712 [02/13/2023-19:50:02] [V] [TRT] Split_262 [Split] inputs: [712 -> (1, 32, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_262 for ONNX node: Split_262 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_262_32 for ONNX node: Split_262 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 713 for ONNX tensor: 713 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 714 for ONNX tensor: 714 [02/13/2023-19:50:02] [V] [TRT] Split_262 [Split] outputs: [713 -> (1, 16, 144, 256)[FLOAT]], [714 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Shape_263 [Shape] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 714 [02/13/2023-19:50:02] [V] [TRT] Shape_263 [Shape] inputs: [714 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Shape_263 for ONNX node: Shape_263 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 715 for ONNX tensor: 715 [02/13/2023-19:50:02] [V] [TRT] Shape_263 [Shape] outputs: [715 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Expand_264 [Expand] [02/13/2023-19:50:02] [V] [TRT] Searching for input: r1i [02/13/2023-19:50:02] [V] [TRT] Searching for input: 715 [02/13/2023-19:50:02] [V] [TRT] Expand_264 [Expand] inputs: [r1i -> (1, 1, 1, 1)[FLOAT]], [715 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Expand_264 for ONNX node: Expand_264 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 716 for ONNX tensor: 716 [02/13/2023-19:50:02] [V] [TRT] Expand_264 [Expand] outputs: [716 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_265 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 714 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 716 [02/13/2023-19:50:02] [V] [TRT] Concat_265 [Concat] inputs: [714 -> (1, 16, 144, 256)[FLOAT]], [716 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_265 for ONNX node: Concat_265 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 717 for ONNX tensor: 717 [02/13/2023-19:50:02] [V] [TRT] Concat_265 [Concat] outputs: [717 -> (1, 32, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_266 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 717 [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode1.gru.ih.0.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode1.gru.ih.0.bias [02/13/2023-19:50:02] [V] [TRT] Conv_266 [Conv] inputs: [717 -> (1, 32, 144, 256)[FLOAT]], [decoder.decode1.gru.ih.0.weight -> (32, 32, 3, 3)[FLOAT]], [decoder.decode1.gru.ih.0.bias -> (32)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 32, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_266 for ONNX node: Conv_266 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 32, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 718 for ONNX tensor: 718 [02/13/2023-19:50:02] [V] [TRT] Conv_266 [Conv] outputs: [718 -> (1, 32, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Sigmoid_267 [Sigmoid] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 718 [02/13/2023-19:50:02] [V] [TRT] Sigmoid_267 [Sigmoid] inputs: [718 -> (1, 32, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Sigmoid_267 for ONNX node: Sigmoid_267 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 719 for ONNX tensor: 719 [02/13/2023-19:50:02] [V] [TRT] Sigmoid_267 [Sigmoid] outputs: [719 -> (1, 32, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Split_268 [Split] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 719 [02/13/2023-19:50:02] [V] [TRT] Split_268 [Split] inputs: [719 -> (1, 32, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_268 for ONNX node: Split_268 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_268_35 for ONNX node: Split_268 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 720 for ONNX tensor: 720 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 721 for ONNX tensor: 721 [02/13/2023-19:50:02] [V] [TRT] Split_268 [Split] outputs: [720 -> (1, 16, 144, 256)[FLOAT]], [721 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_269 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 720 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 716 [02/13/2023-19:50:02] [V] [TRT] Mul_269 [Mul] inputs: [720 -> (1, 16, 144, 256)[FLOAT]], [716 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_269 for ONNX node: Mul_269 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 722 for ONNX tensor: 722 [02/13/2023-19:50:02] [V] [TRT] Mul_269 [Mul] outputs: [722 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_270 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 714 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 722 [02/13/2023-19:50:02] [V] [TRT] Concat_270 [Concat] inputs: [714 -> (1, 16, 144, 256)[FLOAT]], [722 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_270 for ONNX node: Concat_270 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 723 for ONNX tensor: 723 [02/13/2023-19:50:02] [V] [TRT] Concat_270 [Concat] outputs: [723 -> (1, 32, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_271 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 723 [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode1.gru.hh.0.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: decoder.decode1.gru.hh.0.bias [02/13/2023-19:50:02] [V] [TRT] Conv_271 [Conv] inputs: [723 -> (1, 32, 144, 256)[FLOAT]], [decoder.decode1.gru.hh.0.weight -> (16, 32, 3, 3)[FLOAT]], [decoder.decode1.gru.hh.0.bias -> (16)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 32, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_271 for ONNX node: Conv_271 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 16, 144, 256) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 724 for ONNX tensor: 724 [02/13/2023-19:50:02] [V] [TRT] Conv_271 [Conv] outputs: [724 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Tanh_272 [Tanh] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 724 [02/13/2023-19:50:02] [V] [TRT] Tanh_272 [Tanh] inputs: [724 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Tanh_272 for ONNX node: Tanh_272 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 725 for ONNX tensor: 725 [02/13/2023-19:50:02] [V] [TRT] Tanh_272 [Tanh] outputs: [725 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Sub_274 [Sub] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 990 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 721 [02/13/2023-19:50:02] [V] [TRT] Sub_274 [Sub] inputs: [990 -> ()[FLOAT]], [721 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Sub_274 for ONNX node: Sub_274 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 727 for ONNX tensor: 727 [02/13/2023-19:50:02] [V] [TRT] Sub_274 [Sub] outputs: [727 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_275 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 727 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 716 [02/13/2023-19:50:02] [V] [TRT] Mul_275 [Mul] inputs: [727 -> (1, 16, 144, 256)[FLOAT]], [716 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_275 for ONNX node: Mul_275 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 728 for ONNX tensor: 728 [02/13/2023-19:50:02] [V] [TRT] Mul_275 [Mul] outputs: [728 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_276 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 721 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 725 [02/13/2023-19:50:02] [V] [TRT] Mul_276 [Mul] inputs: [721 -> (1, 16, 144, 256)[FLOAT]], [725 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_276 for ONNX node: Mul_276 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 729 for ONNX tensor: 729 [02/13/2023-19:50:02] [V] [TRT] Mul_276 [Mul] outputs: [729 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_277 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 728 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 729 [02/13/2023-19:50:02] [V] [TRT] Add_277 [Add] inputs: [728 -> (1, 16, 144, 256)[FLOAT]], [729 -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_277 for ONNX node: Add_277 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: r1o_36 for ONNX tensor: r1o [02/13/2023-19:50:02] [V] [TRT] Add_277 [Add] outputs: [r1o -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_278 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 713 [02/13/2023-19:50:02] [V] [TRT] Searching for input: r1o [02/13/2023-19:50:02] [V] [TRT] Concat_278 [Concat] inputs: [713 -> (1, 16, 144, 256)[FLOAT]], [r1o -> (1, 16, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_278 for ONNX node: Concat_278 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 731 for ONNX tensor: 731 [02/13/2023-19:50:02] [V] [TRT] Concat_278 [Concat] outputs: [731 -> (1, 32, 144, 256)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Resize_280 [Resize] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 731 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 386 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 985 [02/13/2023-19:50:02] [V] [TRT] Resize_280 [Resize] inputs: [731 -> (1, 32, 144, 256)[FLOAT]], [386 -> (0)[FLOAT]], [985 -> (4)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Resize_280 for ONNX node: Resize_280 [02/13/2023-19:50:02] [V] [TRT] Running resize layer with: Transformation mode: pytorch_half_pixel Resize mode: linear [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 736 for ONNX tensor: 736 [02/13/2023-19:50:02] [V] [TRT] Resize_280 [Resize] outputs: [736 -> (1, 32, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Shape_281 [Shape] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 389 [02/13/2023-19:50:02] [V] [TRT] Shape_281 [Shape] inputs: [389 -> (1, 3, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Shape_281 for ONNX node: Shape_281 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 737 for ONNX tensor: 737 [02/13/2023-19:50:02] [V] [TRT] Shape_281 [Shape] outputs: [737 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Slice_285 [Slice] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 737 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 630 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 631 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 632 [02/13/2023-19:50:02] [V] [TRT] Slice_285 [Slice] inputs: [737 -> (4)[INT32]], [630 -> (1)[INT32]], [631 -> (1)[INT32]], [632 -> (1)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Slice_285 for ONNX node: Slice_285 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 741 for ONNX tensor: 741 [02/13/2023-19:50:02] [V] [TRT] Slice_285 [Slice] outputs: [741 -> (2)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Slice_288 [Slice] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 736 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 634 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 741 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 635 [02/13/2023-19:50:02] [V] [TRT] Slice_288 [Slice] inputs: [736 -> (1, 32, 288, 512)[FLOAT]], [634 -> (2)[INT32]], [741 -> (2)[INT32]], [635 -> (2)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Slice_288 for ONNX node: Slice_288 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 744 for ONNX tensor: 744 [02/13/2023-19:50:02] [V] [TRT] Slice_288 [Slice] outputs: [744 -> (1, 32, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_289 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 744 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 389 [02/13/2023-19:50:02] [V] [TRT] Concat_289 [Concat] inputs: [744 -> (1, 32, 288, 512)[FLOAT]], [389 -> (1, 3, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_289 for ONNX node: Concat_289 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 745 for ONNX tensor: 745 [02/13/2023-19:50:02] [V] [TRT] Concat_289 [Concat] outputs: [745 -> (1, 35, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_290 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 745 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 974 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 975 [02/13/2023-19:50:02] [V] [TRT] Conv_290 [Conv] inputs: [745 -> (1, 35, 288, 512)[FLOAT]], [974 -> (16, 35, 3, 3)[FLOAT]], [975 -> (16)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 35, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_290 for ONNX node: Conv_290 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 16, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 973 for ONNX tensor: 973 [02/13/2023-19:50:02] [V] [TRT] Conv_290 [Conv] outputs: [973 -> (1, 16, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_291 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 973 [02/13/2023-19:50:02] [V] [TRT] Relu_291 [Relu] inputs: [973 -> (1, 16, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_291 for ONNX node: Relu_291 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 748 for ONNX tensor: 748 [02/13/2023-19:50:02] [V] [TRT] Relu_291 [Relu] outputs: [748 -> (1, 16, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_292 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 748 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 977 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 978 [02/13/2023-19:50:02] [V] [TRT] Conv_292 [Conv] inputs: [748 -> (1, 16, 288, 512)[FLOAT]], [977 -> (16, 16, 3, 3)[FLOAT]], [978 -> (16)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 16, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_292 for ONNX node: Conv_292 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 16, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 976 for ONNX tensor: 976 [02/13/2023-19:50:02] [V] [TRT] Conv_292 [Conv] outputs: [976 -> (1, 16, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_293 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 976 [02/13/2023-19:50:02] [V] [TRT] Relu_293 [Relu] inputs: [976 -> (1, 16, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_293 for ONNX node: Relu_293 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 751 for ONNX tensor: 751 [02/13/2023-19:50:02] [V] [TRT] Relu_293 [Relu] outputs: [751 -> (1, 16, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_294 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 751 [02/13/2023-19:50:02] [V] [TRT] Searching for input: project_mat.conv.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: project_mat.conv.bias [02/13/2023-19:50:02] [V] [TRT] Conv_294 [Conv] inputs: [751 -> (1, 16, 288, 512)[FLOAT]], [project_mat.conv.weight -> (4, 16, 1, 1)[FLOAT]], [project_mat.conv.bias -> (4)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 16, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_294 for ONNX node: Conv_294 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 4 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 4, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 752 for ONNX tensor: 752 [02/13/2023-19:50:02] [V] [TRT] Conv_294 [Conv] outputs: [752 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Split_295 [Split] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 752 [02/13/2023-19:50:02] [V] [TRT] Split_295 [Split] inputs: [752 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_295 for ONNX node: Split_295 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_295_43 for ONNX node: Split_295 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 753 for ONNX tensor: 753 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 754 for ONNX tensor: 754 [02/13/2023-19:50:02] [V] [TRT] Split_295 [Split] outputs: [753 -> (1, 3, 288, 512)[FLOAT]], [754 -> (1, 1, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: ReduceMean_296 [ReduceMean] [02/13/2023-19:50:02] [V] [TRT] Searching for input: src [02/13/2023-19:50:02] [V] [TRT] ReduceMean_296 [ReduceMean] inputs: [src -> (1, 3, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: ReduceMean_296 for ONNX node: ReduceMean_296 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 755 for ONNX tensor: 755 [02/13/2023-19:50:02] [V] [TRT] ReduceMean_296 [ReduceMean] outputs: [755 -> (1, 1, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_297 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: src [02/13/2023-19:50:02] [V] [TRT] Searching for input: 755 [02/13/2023-19:50:02] [V] [TRT] Concat_297 [Concat] inputs: [src -> (1, 3, 1440, 2560)[FLOAT]], [755 -> (1, 1, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_297 for ONNX node: Concat_297 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 756 for ONNX tensor: 756 [02/13/2023-19:50:02] [V] [TRT] Concat_297 [Concat] outputs: [756 -> (1, 4, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: ReduceMean_298 [ReduceMean] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 389 [02/13/2023-19:50:02] [V] [TRT] ReduceMean_298 [ReduceMean] inputs: [389 -> (1, 3, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: ReduceMean_298 for ONNX node: ReduceMean_298 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 757 for ONNX tensor: 757 [02/13/2023-19:50:02] [V] [TRT] ReduceMean_298 [ReduceMean] outputs: [757 -> (1, 1, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_299 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 389 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 757 [02/13/2023-19:50:02] [V] [TRT] Concat_299 [Concat] inputs: [389 -> (1, 3, 288, 512)[FLOAT]], [757 -> (1, 1, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_299 for ONNX node: Concat_299 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 758 for ONNX tensor: 758 [02/13/2023-19:50:02] [V] [TRT] Concat_299 [Concat] outputs: [758 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_300 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 753 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 754 [02/13/2023-19:50:02] [V] [TRT] Concat_300 [Concat] inputs: [753 -> (1, 3, 288, 512)[FLOAT]], [754 -> (1, 1, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_300 for ONNX node: Concat_300 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 759 for ONNX tensor: 759 [02/13/2023-19:50:02] [V] [TRT] Concat_300 [Concat] outputs: [759 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_301 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 758 [02/13/2023-19:50:02] [V] [TRT] Searching for input: refiner.box_filter.weight [02/13/2023-19:50:02] [V] [TRT] Conv_301 [Conv] inputs: [758 -> (1, 4, 288, 512)[FLOAT]], [refiner.box_filter.weight -> (4, 1, 3, 3)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 4, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_301 for ONNX node: Conv_301 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 4 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 4, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 760 for ONNX tensor: 760 [02/13/2023-19:50:02] [V] [TRT] Conv_301 [Conv] outputs: [760 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_302 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 759 [02/13/2023-19:50:02] [V] [TRT] Searching for input: refiner.box_filter.weight [02/13/2023-19:50:02] [V] [TRT] Conv_302 [Conv] inputs: [759 -> (1, 4, 288, 512)[FLOAT]], [refiner.box_filter.weight -> (4, 1, 3, 3)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 4, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_302 for ONNX node: Conv_302 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 4 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 4, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 761 for ONNX tensor: 761 [02/13/2023-19:50:02] [V] [TRT] Conv_302 [Conv] outputs: [761 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_303 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 758 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 759 [02/13/2023-19:50:02] [V] [TRT] Mul_303 [Mul] inputs: [758 -> (1, 4, 288, 512)[FLOAT]], [759 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_303 for ONNX node: Mul_303 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 762 for ONNX tensor: 762 [02/13/2023-19:50:02] [V] [TRT] Mul_303 [Mul] outputs: [762 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_304 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 762 [02/13/2023-19:50:02] [V] [TRT] Searching for input: refiner.box_filter.weight [02/13/2023-19:50:02] [V] [TRT] Conv_304 [Conv] inputs: [762 -> (1, 4, 288, 512)[FLOAT]], [refiner.box_filter.weight -> (4, 1, 3, 3)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 4, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_304 for ONNX node: Conv_304 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 4 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 4, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 763 for ONNX tensor: 763 [02/13/2023-19:50:02] [V] [TRT] Conv_304 [Conv] outputs: [763 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_305 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 760 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 761 [02/13/2023-19:50:02] [V] [TRT] Mul_305 [Mul] inputs: [760 -> (1, 4, 288, 512)[FLOAT]], [761 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_305 for ONNX node: Mul_305 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 764 for ONNX tensor: 764 [02/13/2023-19:50:02] [V] [TRT] Mul_305 [Mul] outputs: [764 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Sub_306 [Sub] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 763 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 764 [02/13/2023-19:50:02] [V] [TRT] Sub_306 [Sub] inputs: [763 -> (1, 4, 288, 512)[FLOAT]], [764 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Sub_306 for ONNX node: Sub_306 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 765 for ONNX tensor: 765 [02/13/2023-19:50:02] [V] [TRT] Sub_306 [Sub] outputs: [765 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_307 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 758 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 758 [02/13/2023-19:50:02] [V] [TRT] Mul_307 [Mul] inputs: [758 -> (1, 4, 288, 512)[FLOAT]], [758 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_307 for ONNX node: Mul_307 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 766 for ONNX tensor: 766 [02/13/2023-19:50:02] [V] [TRT] Mul_307 [Mul] outputs: [766 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_308 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 766 [02/13/2023-19:50:02] [V] [TRT] Searching for input: refiner.box_filter.weight [02/13/2023-19:50:02] [V] [TRT] Conv_308 [Conv] inputs: [766 -> (1, 4, 288, 512)[FLOAT]], [refiner.box_filter.weight -> (4, 1, 3, 3)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 4, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_308 for ONNX node: Conv_308 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 4 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 4, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 767 for ONNX tensor: 767 [02/13/2023-19:50:02] [V] [TRT] Conv_308 [Conv] outputs: [767 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_309 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 760 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 760 [02/13/2023-19:50:02] [V] [TRT] Mul_309 [Mul] inputs: [760 -> (1, 4, 288, 512)[FLOAT]], [760 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_309 for ONNX node: Mul_309 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 768 for ONNX tensor: 768 [02/13/2023-19:50:02] [V] [TRT] Mul_309 [Mul] outputs: [768 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Sub_310 [Sub] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 767 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 768 [02/13/2023-19:50:02] [V] [TRT] Sub_310 [Sub] inputs: [767 -> (1, 4, 288, 512)[FLOAT]], [768 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Sub_310 for ONNX node: Sub_310 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 769 for ONNX tensor: 769 [02/13/2023-19:50:02] [V] [TRT] Sub_310 [Sub] outputs: [769 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_311 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 765 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 769 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 751 [02/13/2023-19:50:02] [V] [TRT] Concat_311 [Concat] inputs: [765 -> (1, 4, 288, 512)[FLOAT]], [769 -> (1, 4, 288, 512)[FLOAT]], [751 -> (1, 16, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_311 for ONNX node: Concat_311 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 770 for ONNX tensor: 770 [02/13/2023-19:50:02] [V] [TRT] Concat_311 [Concat] outputs: [770 -> (1, 24, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_312 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 770 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 980 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 981 [02/13/2023-19:50:02] [V] [TRT] Conv_312 [Conv] inputs: [770 -> (1, 24, 288, 512)[FLOAT]], [980 -> (16, 24, 1, 1)[FLOAT]], [981 -> (16)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 24, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_312 for ONNX node: Conv_312 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 16 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 16, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 979 for ONNX tensor: 979 [02/13/2023-19:50:02] [V] [TRT] Conv_312 [Conv] outputs: [979 -> (1, 16, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_313 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 979 [02/13/2023-19:50:02] [V] [TRT] Relu_313 [Relu] inputs: [979 -> (1, 16, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_313 for ONNX node: Relu_313 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 773 for ONNX tensor: 773 [02/13/2023-19:50:02] [V] [TRT] Relu_313 [Relu] outputs: [773 -> (1, 16, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_314 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 773 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 983 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 984 [02/13/2023-19:50:02] [V] [TRT] Conv_314 [Conv] inputs: [773 -> (1, 16, 288, 512)[FLOAT]], [983 -> (16, 16, 1, 1)[FLOAT]], [984 -> (16)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 16, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_314 for ONNX node: Conv_314 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 16 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 16, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 982 for ONNX tensor: 982 [02/13/2023-19:50:02] [V] [TRT] Conv_314 [Conv] outputs: [982 -> (1, 16, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Relu_315 [Relu] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 982 [02/13/2023-19:50:02] [V] [TRT] Relu_315 [Relu] inputs: [982 -> (1, 16, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Relu_315 for ONNX node: Relu_315 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 776 for ONNX tensor: 776 [02/13/2023-19:50:02] [V] [TRT] Relu_315 [Relu] outputs: [776 -> (1, 16, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Conv_316 [Conv] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 776 [02/13/2023-19:50:02] [V] [TRT] Searching for input: refiner.conv.6.weight [02/13/2023-19:50:02] [V] [TRT] Searching for input: refiner.conv.6.bias [02/13/2023-19:50:02] [V] [TRT] Conv_316 [Conv] inputs: [776 -> (1, 16, 288, 512)[FLOAT]], [refiner.conv.6.weight -> (4, 16, 1, 1)[FLOAT]], [refiner.conv.6.bias -> (4)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Convolution input dimensions: (1, 16, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering layer: Conv_316 for ONNX node: Conv_316 [02/13/2023-19:50:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 4 [02/13/2023-19:50:02] [V] [TRT] Convolution output dimensions: (1, 4, 288, 512) [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 777 for ONNX tensor: 777 [02/13/2023-19:50:02] [V] [TRT] Conv_316 [Conv] outputs: [777 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_317 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 777 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 760 [02/13/2023-19:50:02] [V] [TRT] Mul_317 [Mul] inputs: [777 -> (1, 4, 288, 512)[FLOAT]], [760 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_317 for ONNX node: Mul_317 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 778 for ONNX tensor: 778 [02/13/2023-19:50:02] [V] [TRT] Mul_317 [Mul] outputs: [778 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Sub_318 [Sub] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 761 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 778 [02/13/2023-19:50:02] [V] [TRT] Sub_318 [Sub] inputs: [761 -> (1, 4, 288, 512)[FLOAT]], [778 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Sub_318 for ONNX node: Sub_318 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 779 for ONNX tensor: 779 [02/13/2023-19:50:02] [V] [TRT] Sub_318 [Sub] outputs: [779 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Shape_321 [Shape] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 777 [02/13/2023-19:50:02] [V] [TRT] Shape_321 [Shape] inputs: [777 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Shape_321 for ONNX node: Shape_321 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 782 for ONNX tensor: 782 [02/13/2023-19:50:02] [V] [TRT] Shape_321 [Shape] outputs: [782 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Slice_325 [Slice] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 782 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 632 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 630 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 632 [02/13/2023-19:50:02] [V] [TRT] Slice_325 [Slice] inputs: [782 -> (4)[INT32]], [632 -> (1)[INT32]], [630 -> (1)[INT32]], [632 -> (1)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Slice_325 for ONNX node: Slice_325 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 786 for ONNX tensor: 786 [02/13/2023-19:50:02] [V] [TRT] Slice_325 [Slice] outputs: [786 -> (2)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_331 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 786 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 815 [02/13/2023-19:50:02] [V] [TRT] Concat_331 [Concat] inputs: [786 -> (2)[INT32]], [815 -> (2)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: 815 for ONNX node: 815 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_331 for ONNX node: Concat_331 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 792 for ONNX tensor: 792 [02/13/2023-19:50:02] [V] [TRT] Concat_331 [Concat] outputs: [792 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Resize_332 [Resize] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 777 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 386 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 386 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 792 [02/13/2023-19:50:02] [V] [TRT] Resize_332 [Resize] inputs: [777 -> (1, 4, 288, 512)[FLOAT]], [386 -> (0)[FLOAT]], [386 -> (0)[FLOAT]], [792 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Resize_332 for ONNX node: Resize_332 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 793 for ONNX tensor: 793 [02/13/2023-19:50:02] [V] [TRT] Resize_332 [Resize] outputs: [793 -> (1, 4, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Shape_335 [Shape] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 779 [02/13/2023-19:50:02] [V] [TRT] Shape_335 [Shape] inputs: [779 -> (1, 4, 288, 512)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Shape_335 for ONNX node: Shape_335 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 796 for ONNX tensor: 796 [02/13/2023-19:50:02] [V] [TRT] Shape_335 [Shape] outputs: [796 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Slice_339 [Slice] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 796 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 632 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 630 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 632 [02/13/2023-19:50:02] [V] [TRT] Slice_339 [Slice] inputs: [796 -> (4)[INT32]], [632 -> (1)[INT32]], [630 -> (1)[INT32]], [632 -> (1)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Slice_339 for ONNX node: Slice_339 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 800 for ONNX tensor: 800 [02/13/2023-19:50:02] [V] [TRT] Slice_339 [Slice] outputs: [800 -> (2)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Concat_345 [Concat] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 800 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 815 [02/13/2023-19:50:02] [V] [TRT] Concat_345 [Concat] inputs: [800 -> (2)[INT32]], [815 -> (2)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Concat_345 for ONNX node: Concat_345 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 806 for ONNX tensor: 806 [02/13/2023-19:50:02] [V] [TRT] Concat_345 [Concat] outputs: [806 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Resize_346 [Resize] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 779 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 386 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 386 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 806 [02/13/2023-19:50:02] [V] [TRT] Resize_346 [Resize] inputs: [779 -> (1, 4, 288, 512)[FLOAT]], [386 -> (0)[FLOAT]], [386 -> (0)[FLOAT]], [806 -> (4)[INT32]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Resize_346 for ONNX node: Resize_346 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 807 for ONNX tensor: 807 [02/13/2023-19:50:02] [V] [TRT] Resize_346 [Resize] outputs: [807 -> (1, 4, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Mul_347 [Mul] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 793 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 756 [02/13/2023-19:50:02] [V] [TRT] Mul_347 [Mul] inputs: [793 -> (1, 4, 1440, 2560)[FLOAT]], [756 -> (1, 4, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Mul_347 for ONNX node: Mul_347 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 808 for ONNX tensor: 808 [02/13/2023-19:50:02] [V] [TRT] Mul_347 [Mul] outputs: [808 -> (1, 4, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_348 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 808 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 807 [02/13/2023-19:50:02] [V] [TRT] Add_348 [Add] inputs: [808 -> (1, 4, 1440, 2560)[FLOAT]], [807 -> (1, 4, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_348 for ONNX node: Add_348 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 809 for ONNX tensor: 809 [02/13/2023-19:50:02] [V] [TRT] Add_348 [Add] outputs: [809 -> (1, 4, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Split_349 [Split] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 809 [02/13/2023-19:50:02] [V] [TRT] Split_349 [Split] inputs: [809 -> (1, 4, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_349 for ONNX node: Split_349 [02/13/2023-19:50:02] [V] [TRT] Registering layer: Split_349_44 for ONNX node: Split_349 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 810 for ONNX tensor: 810 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 811 for ONNX tensor: 811 [02/13/2023-19:50:02] [V] [TRT] Split_349 [Split] outputs: [810 -> (1, 3, 1440, 2560)[FLOAT]], [811 -> (1, 1, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Add_350 [Add] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 810 [02/13/2023-19:50:02] [V] [TRT] Searching for input: src [02/13/2023-19:50:02] [V] [TRT] Add_350 [Add] inputs: [810 -> (1, 3, 1440, 2560)[FLOAT]], [src -> (1, 3, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Add_350 for ONNX node: Add_350 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: 812 for ONNX tensor: 812 [02/13/2023-19:50:02] [V] [TRT] Add_350 [Add] outputs: [812 -> (1, 3, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Clip_351 [Clip] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 812 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 989 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 990 [02/13/2023-19:50:02] [V] [TRT] Clip_351 [Clip] inputs: [812 -> (1, 3, 1440, 2560)[FLOAT]], [989 -> ()[FLOAT]], [990 -> ()[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Clip_351 for ONNX node: Clip_351 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: fgr_45 for ONNX tensor: fgr [02/13/2023-19:50:02] [V] [TRT] Clip_351 [Clip] outputs: [fgr -> (1, 3, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Parsing node: Clip_352 [Clip] [02/13/2023-19:50:02] [V] [TRT] Searching for input: 811 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 989 [02/13/2023-19:50:02] [V] [TRT] Searching for input: 990 [02/13/2023-19:50:02] [V] [TRT] Clip_352 [Clip] inputs: [811 -> (1, 1, 1440, 2560)[FLOAT]], [989 -> ()[FLOAT]], [990 -> ()[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Registering layer: Clip_352 for ONNX node: Clip_352 [02/13/2023-19:50:02] [V] [TRT] Registering tensor: pha_46 for ONNX tensor: pha [02/13/2023-19:50:02] [V] [TRT] Clip_352 [Clip] outputs: [pha -> (1, 1, 1440, 2560)[FLOAT]], [02/13/2023-19:50:02] [V] [TRT] Marking fgr_45 as output: fgr [02/13/2023-19:50:02] [V] [TRT] Marking pha_46 as output: pha [02/13/2023-19:50:02] [V] [TRT] Marking r1o_36 as output: r1o [02/13/2023-19:50:02] [V] [TRT] Marking r2o_25 as output: r2o [02/13/2023-19:50:02] [V] [TRT] Marking r3o_14 as output: r3o [02/13/2023-19:50:02] [V] [TRT] Marking r4o_3 as output: r4o [02/13/2023-19:50:02] [I] Finish parsing network model [02/13/2023-19:50:02] [V] [TRT] Applying generic optimizations to the graph for inference. [02/13/2023-19:50:02] [V] [TRT] Original: 301 layers [02/13/2023-19:50:02] [V] [TRT] After dead-layer removal: 301 layers [02/13/2023-19:50:02] [V] [TRT] Running: ConstShuffleFusion on 390 [02/13/2023-19:50:02] [V] [TRT] ConstShuffleFusion: Fusing 390 with (Unnamed Layer* 2) [Shuffle] [02/13/2023-19:50:02] [V] [TRT] Running: ConstShuffleFusion on 392 [02/13/2023-19:50:02] [V] [TRT] ConstShuffleFusion: Fusing 392 with (Unnamed Layer* 5) [Shuffle] [02/13/2023-19:50:02] [V] [TRT] After Myelin optimization: 299 layers [02/13/2023-19:50:02] [V] [TRT] Applying ScaleNodes fusions. [02/13/2023-19:50:02] [V] [TRT] After scale fusion: 299 layers [02/13/2023-19:50:02] [V] [TRT] Running: ConstantSplit on 990 [02/13/2023-19:50:02] [V] [TRT] Running: ConstShuffleFusion on 990 [02/13/2023-19:50:02] [V] [TRT] ConstShuffleFusion: Fusing 990 with (Unnamed Layer* 191) [Shuffle] [02/13/2023-19:50:02] [V] [TRT] Running: ConstShuffleFusion on 990_clone_1 [02/13/2023-19:50:02] [V] [TRT] ConstShuffleFusion: Fusing 990_clone_1 with (Unnamed Layer* 238) [Shuffle] [02/13/2023-19:50:02] [V] [TRT] Running: ConstShuffleFusion on 990_clone_2 [02/13/2023-19:50:02] [V] [TRT] ConstShuffleFusion: Fusing 990_clone_2 with (Unnamed Layer* 285) [Shuffle] [02/13/2023-19:50:02] [V] [TRT] Running: ConstShuffleFusion on 990_clone_3 [02/13/2023-19:50:02] [V] [TRT] ConstShuffleFusion: Fusing 990_clone_3 with (Unnamed Layer* 332) [Shuffle] [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_11 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_11 with Relu_12 [02/13/2023-19:50:02] [V] [TRT] Running: ConvEltwiseSumFusion on Conv_13 [02/13/2023-19:50:02] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_13 with Add_14 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_15 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_15 with Relu_16 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_17 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_17 with Relu_18 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_20 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_20 with Relu_21 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_22 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_22 with Relu_23 [02/13/2023-19:50:02] [V] [TRT] Running: ConvEltwiseSumFusion on Conv_24 [02/13/2023-19:50:02] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_24 with Add_25 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_26 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_26 with Relu_27 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_28 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_28 with Relu_29 [02/13/2023-19:50:02] [V] [TRT] Running: ReduceToPoolingFusion on GlobalAveragePool_30 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of GlobalAveragePool_30 from REDUCE to POOLING [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_31 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_31 with Relu_32 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_37 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_37 with Relu_38 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_39 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_39 with Relu_40 [02/13/2023-19:50:02] [V] [TRT] Running: ReduceToPoolingFusion on GlobalAveragePool_41 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of GlobalAveragePool_41 from REDUCE to POOLING [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_42 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_42 with Relu_43 [02/13/2023-19:50:02] [V] [TRT] Running: ConvEltwiseSumFusion on Conv_47 [02/13/2023-19:50:02] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_47 with Add_48 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_49 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_49 with Relu_50 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_51 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_51 with Relu_52 [02/13/2023-19:50:02] [V] [TRT] Running: ReduceToPoolingFusion on GlobalAveragePool_53 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of GlobalAveragePool_53 from REDUCE to POOLING [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_54 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_54 with Relu_55 [02/13/2023-19:50:02] [V] [TRT] Running: ConvEltwiseSumFusion on Conv_59 [02/13/2023-19:50:02] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_59 with Add_60 [02/13/2023-19:50:02] [V] [TRT] Running: ConvEltwiseSumFusion on Conv_74 [02/13/2023-19:50:02] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_74 with Add_75 [02/13/2023-19:50:02] [V] [TRT] Running: ConvEltwiseSumFusion on Conv_82 [02/13/2023-19:50:02] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_82 with Add_83 [02/13/2023-19:50:02] [V] [TRT] Running: ConvEltwiseSumFusion on Conv_90 [02/13/2023-19:50:02] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_90 with Add_91 [02/13/2023-19:50:02] [V] [TRT] Running: ReduceToPoolingFusion on GlobalAveragePool_98 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of GlobalAveragePool_98 from REDUCE to POOLING [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_99 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_99 with Relu_100 [02/13/2023-19:50:02] [V] [TRT] Running: ReduceToPoolingFusion on GlobalAveragePool_111 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of GlobalAveragePool_111 from REDUCE to POOLING [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_112 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_112 with Relu_113 [02/13/2023-19:50:02] [V] [TRT] Running: ConvEltwiseSumFusion on Conv_117 [02/13/2023-19:50:02] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_117 with Add_118 [02/13/2023-19:50:02] [V] [TRT] Running: ReduceToPoolingFusion on GlobalAveragePool_125 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of GlobalAveragePool_125 from REDUCE to POOLING [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_126 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_126 with Relu_127 [02/13/2023-19:50:02] [V] [TRT] Running: ReduceToPoolingFusion on GlobalAveragePool_138 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of GlobalAveragePool_138 from REDUCE to POOLING [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_139 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_139 with Relu_140 [02/13/2023-19:50:02] [V] [TRT] Running: ConvEltwiseSumFusion on Conv_144 [02/13/2023-19:50:02] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_144 with Add_145 [02/13/2023-19:50:02] [V] [TRT] Running: ReduceToPoolingFusion on GlobalAveragePool_152 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of GlobalAveragePool_152 from REDUCE to POOLING [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_153 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_153 with Relu_154 [02/13/2023-19:50:02] [V] [TRT] Running: ConvEltwiseSumFusion on Conv_158 [02/13/2023-19:50:02] [V] [TRT] ConvEltwiseSumFusion: Fusing Conv_158 with Add_159 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_163 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_163 with Relu_164 [02/13/2023-19:50:02] [V] [TRT] Running: ReduceToPoolingFusion on GlobalAveragePool_165 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of GlobalAveragePool_165 from REDUCE to POOLING [02/13/2023-19:50:02] [V] [TRT] Running: SliceErasure on Slice_198 [02/13/2023-19:50:02] [V] [TRT] Removing Slice_198 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_200 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_200 with Relu_201 [02/13/2023-19:50:02] [V] [TRT] Running: SliceErasure on Slice_228 [02/13/2023-19:50:02] [V] [TRT] Removing Slice_228 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_230 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_230 with Relu_231 [02/13/2023-19:50:02] [V] [TRT] Running: SliceErasure on Slice_258 [02/13/2023-19:50:02] [V] [TRT] Removing Slice_258 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_260 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_260 with Relu_261 [02/13/2023-19:50:02] [V] [TRT] Running: SliceErasure on Slice_288 [02/13/2023-19:50:02] [V] [TRT] Removing Slice_288 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_290 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_290 with Relu_291 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_292 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_292 with Relu_293 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_312 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_312 with Relu_313 [02/13/2023-19:50:02] [V] [TRT] Running: ConvReluFusion on Conv_314 [02/13/2023-19:50:02] [V] [TRT] ConvReluFusion: Fusing Conv_314 with Relu_315 [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_9 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_9 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_34 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_34 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_45 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_45 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_57 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_57 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_62 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_62 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_65 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_65 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_69 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_69 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_72 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_72 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_77 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_77 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_80 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_80 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_85 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_85 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_88 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_88 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_93 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_93 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_96 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_96 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_102 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_102 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_106 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_106 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_109 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_109 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_115 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_115 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_120 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_120 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_123 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_123 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_129 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_129 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_133 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_133 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_136 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_136 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_142 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_142 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_147 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_147 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_150 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_150 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_156 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_156 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on HardSigmoid_161 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of HardSigmoid_161 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on Sigmoid_167 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of Sigmoid_167 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on Sigmoid_177 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of Sigmoid_177 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on Tanh_182 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of Tanh_182 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on Sigmoid_207 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of Sigmoid_207 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on Tanh_212 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of Tanh_212 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on Sigmoid_237 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of Sigmoid_237 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on Tanh_242 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of Tanh_242 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on Sigmoid_267 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of Sigmoid_267 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on Tanh_272 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of Tanh_272 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on Clip_351 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of Clip_351 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] Running: ActivationToPointwiseConversion on Clip_352 [02/13/2023-19:50:02] [V] [TRT] Swap the layer type of Clip_352 from ACTIVATION to POINTWISE [02/13/2023-19:50:02] [V] [TRT] After dupe layer removal: 257 layers [02/13/2023-19:50:02] [V] [TRT] After final dead-layer removal: 257 layers [02/13/2023-19:50:02] [V] [TRT] After tensor merging: 257 layers [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on 990 + (Unnamed Layer* 191) [Shuffle] [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing 990 + (Unnamed Layer* 191) [Shuffle] with Sub_184 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on 990_clone_1 + (Unnamed Layer* 238) [Shuffle] [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing 990_clone_1 + (Unnamed Layer* 238) [Shuffle] with Sub_214 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on 990_clone_2 + (Unnamed Layer* 285) [Shuffle] [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing 990_clone_2 + (Unnamed Layer* 285) [Shuffle] with Sub_244 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on 990_clone_3 + (Unnamed Layer* 332) [Shuffle] [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing 990_clone_3 + (Unnamed Layer* 332) [Shuffle] with Sub_274 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on Sub_5 [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing Sub_5 with Div_7 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on Mul_309 [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing Mul_309 with Sub_310 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_9) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_9) with Mul_10 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_34) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_34) with Mul_35 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_45) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_45) with Mul_46 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_57) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_57) with Mul_58 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_62) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_62) with Mul_63 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_65) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_65) with Mul_66 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_69) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_69) with Mul_70 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_72) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_72) with Mul_73 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_77) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_77) with Mul_78 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_80) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_80) with Mul_81 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_85) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_85) with Mul_86 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_88) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_88) with Mul_89 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_93) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_93) with Mul_94 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_96) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_96) with Mul_97 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_102) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_102) with Mul_103 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_106) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_106) with Mul_107 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_109) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_109) with Mul_110 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_115) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_115) with Mul_116 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_120) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_120) with Mul_121 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_123) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_123) with Mul_124 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_129) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_129) with Mul_130 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_133) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_133) with Mul_134 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_136) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_136) with Mul_137 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_142) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_142) with Mul_143 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_147) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_147) with Mul_148 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_150) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_150) with Mul_151 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_156) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_156) with Mul_157 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(HardSigmoid_161) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(HardSigmoid_161) with Mul_162 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(Sigmoid_167) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(Sigmoid_167) with Mul_168 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184) with Mul_185 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185) with Add_187 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(Tanh_182) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(Tanh_182) with Mul_186 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(PWN(Tanh_182), Mul_186) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(Tanh_182), Mul_186) with PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187) [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214) with Mul_215 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215) with Add_217 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(Tanh_212) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(Tanh_212) with Mul_216 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(PWN(Tanh_212), Mul_216) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(Tanh_212), Mul_216) with PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217) [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244) with Mul_245 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245) with Add_247 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(Tanh_242) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(Tanh_242) with Mul_246 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(PWN(Tanh_242), Mul_246) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(Tanh_242), Mul_246) with PWN(PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245), Add_247) [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274) with Mul_275 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275) with Add_277 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(Tanh_272) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(Tanh_272) with Mul_276 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on PWN(PWN(Tanh_272), Mul_276) [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(Tanh_272), Mul_276) with PWN(PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275), Add_277) [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on Mul_305 [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing Mul_305 with Sub_306 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on Mul_317 [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing Mul_317 with Sub_318 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on Mul_347 [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing Mul_347 with Add_348 [02/13/2023-19:50:02] [V] [TRT] Running: PointWiseFusion on Add_350 [02/13/2023-19:50:02] [V] [TRT] PointWiseFusion: Fusing Add_350 with PWN(Clip_351) [02/13/2023-19:50:02] [V] [TRT] After vertical fusions: 202 layers [02/13/2023-19:50:02] [V] [TRT] After dupe layer removal: 202 layers [02/13/2023-19:50:02] [V] [TRT] After final dead-layer removal: 202 layers [02/13/2023-19:50:02] [V] [TRT] After tensor merging: 202 layers [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_172 by retargeting 605 from 605 to 601 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_172_0 by retargeting 606 from 606 to 601 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_178 by retargeting 612 from 612 to 611 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_178_2 by retargeting 613 from 613 to 611 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_202 by retargeting 641 from 641 to 640 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_202_10 by retargeting 642 from 642 to 640 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_208 by retargeting 648 from 648 to 647 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_208_13 by retargeting 649 from 649 to 647 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_232 by retargeting 677 from 677 to 676 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_232_21 by retargeting 678 from 678 to 676 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_238 by retargeting 684 from 684 to 683 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_238_24 by retargeting 685 from 685 to 683 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_262 by retargeting 713 from 713 to 712 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_262_32 by retargeting 714 from 714 to 712 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_268 by retargeting 720 from 720 to 719 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_268_35 by retargeting 721 from 721 to 719 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_295 by retargeting 753 from 753 to 752 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_295_43 by retargeting 754 from 754 to 752 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_349 by retargeting 810 from 810 to 809 [02/13/2023-19:50:02] [V] [TRT] Eliminating slice Split_349_44 by retargeting 811 from 811 to 809 [02/13/2023-19:50:02] [V] [TRT] After slice removal: 182 layers [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_311 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 765 to 770 because of stomping hazard. [02/13/2023-19:50:02] [V] [TRT] Retargeting 769 to 770 [02/13/2023-19:50:02] [V] [TRT] Retargeting 751 to 770 [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_300 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 752 to 759 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Generating copy for 752 to 759 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_289 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 736 to 745 because input does not support striding. [02/13/2023-19:50:02] [V] [TRT] Generating copy for 389 to 745 because input does not support striding. [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_278 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 712 to 731 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Generating copy for r1o to 731 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_270 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 712 to 723 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Retargeting 722 to 723 [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_265 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 712 to 717 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Retargeting 716 to 717 [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_259 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 700 to 709 because input does not support striding. [02/13/2023-19:50:02] [V] [TRT] Generating copy for 403 to 709 because input does not support striding. [02/13/2023-19:50:02] [V] [TRT] Retargeting 602 to 709 [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_248 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 676 to 695 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Generating copy for r2o to 695 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_240 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 676 to 687 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Retargeting 686 to 687 [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_235 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 676 to 681 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Retargeting 680 to 681 [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_229 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 664 to 673 because input does not support striding. [02/13/2023-19:50:02] [V] [TRT] Generating copy for 420 to 673 because input does not support striding. [02/13/2023-19:50:02] [V] [TRT] Retargeting 603 to 673 [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_218 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 640 to 659 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Generating copy for r3o to 659 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_210 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 640 to 651 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Retargeting 650 to 651 [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_205 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 640 to 645 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Retargeting 644 to 645 [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_199 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 628 to 637 because input does not support striding. [02/13/2023-19:50:02] [V] [TRT] Generating copy for 464 to 637 because input does not support striding. [02/13/2023-19:50:02] [V] [TRT] Retargeting 604 to 637 [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_188 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 601 to 623 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Generating copy for r4o to 623 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_180 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 601 to 615 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Retargeting 614 to 615 [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_175 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 601 to 609 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Retargeting 608 to 609 [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_299 [02/13/2023-19:50:02] [V] [TRT] Generating copy for 389 to 758 because input does not support striding. [02/13/2023-19:50:02] [V] [TRT] Generating copy for 757 to 758 because input does not support striding. [02/13/2023-19:50:02] [V] [TRT] Eliminating concatenation Concat_297 [02/13/2023-19:50:02] [V] [TRT] Generating copy for src to 756 because input is not movable. [02/13/2023-19:50:02] [V] [TRT] Generating copy for 755 to 756 because input does not support striding. [02/13/2023-19:50:02] [V] [TRT] After concat removal: 193 layers [02/13/2023-19:50:02] [V] [TRT] Trying to split Reshape and strided tensor [02/13/2023-19:50:02] [V] [TRT] Graph construction and optimization completed in 0.119694 seconds. [02/13/2023-19:50:02] [I] [TRT] ---------- Layers Running on DLA ---------- [02/13/2023-19:50:02] [I] [TRT] ---------- Layers Running on GPU ---------- [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: Reformatting CopyNode for Network Input src [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONSTANT: 390 + (Unnamed Layer* 2) [Shuffle] [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONSTANT: 392 + (Unnamed Layer* 5) [Shuffle] [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] RESIZE: Resize_3 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_296 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POOLING: AveragePool_169 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_298 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: src copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 755 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POOLING: AveragePool_170 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 389 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 757 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(Sub_5, Div_7) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POOLING: AveragePool_171 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_301 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] ELEMENTWISE: Mul_307 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_8 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_308 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(Mul_309, Sub_310) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_9), Mul_10) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_11 + Relu_12 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_13 + Add_14 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_15 + Relu_16 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_17 + Relu_18 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_19 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_20 + Relu_21 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_22 + Relu_23 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_24 + Add_25 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_26 + Relu_27 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_28 + Relu_29 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POOLING: GlobalAveragePool_30 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_31 + Relu_32 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_33 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_34), Mul_35) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_36 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_37 + Relu_38 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_39 + Relu_40 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POOLING: GlobalAveragePool_41 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_42 + Relu_43 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_44 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_45), Mul_46) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_47 + Add_48 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_49 + Relu_50 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_51 + Relu_52 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POOLING: GlobalAveragePool_53 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_54 + Relu_55 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_56 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_57), Mul_58) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_59 + Add_60 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_61 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_62), Mul_63) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_64 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_65), Mul_66) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_67 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_68 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_69), Mul_70) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_71 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_72), Mul_73) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_74 + Add_75 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_76 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_77), Mul_78) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_79 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_80), Mul_81) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_82 + Add_83 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_84 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_85), Mul_86) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_87 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_88), Mul_89) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_90 + Add_91 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_92 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_93), Mul_94) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_95 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_96), Mul_97) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POOLING: GlobalAveragePool_98 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_99 + Relu_100 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_101 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_102), Mul_103) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_104 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_105 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_106), Mul_107) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_108 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_109), Mul_110) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POOLING: GlobalAveragePool_111 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_112 + Relu_113 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_114 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_115), Mul_116) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_117 + Add_118 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_119 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_120), Mul_121) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_122 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_123), Mul_124) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POOLING: GlobalAveragePool_125 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_126 + Relu_127 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_128 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_129), Mul_130) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_131 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_132 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_133), Mul_134) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_135 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_136), Mul_137) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POOLING: GlobalAveragePool_138 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_139 + Relu_140 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_141 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_142), Mul_143) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_144 + Add_145 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_146 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_147), Mul_148) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_149 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_150), Mul_151) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POOLING: GlobalAveragePool_152 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_153 + Relu_154 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_155 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_156), Mul_157) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_158 + Add_159 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_160 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(HardSigmoid_161), Mul_162) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_163 + Relu_164 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POOLING: GlobalAveragePool_165 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_166 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(Sigmoid_167), Mul_168) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] SLICE: Expand_174 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 606 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_176 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(Sigmoid_177) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] ELEMENTWISE: Mul_179 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 606 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_181 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 605 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: r4o copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] RESIZE: Resize_190 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 628 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 464 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_200 + Relu_201 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] SLICE: Expand_204 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 642 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_206 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(Sigmoid_207) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] ELEMENTWISE: Mul_209 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 642 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_211 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 641 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: r3o copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] RESIZE: Resize_220 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 664 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 420 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_230 + Relu_231 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] SLICE: Expand_234 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 678 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_236 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(Sigmoid_237) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] ELEMENTWISE: Mul_239 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 678 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_241 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(Tanh_242), Mul_246), PWN(PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245), Add_247)) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 677 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: r2o copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] RESIZE: Resize_250 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 700 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 403 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_260 + Relu_261 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] SLICE: Expand_264 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 714 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_266 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(Sigmoid_267) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] ELEMENTWISE: Mul_269 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 714 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_271 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(Tanh_272), Mul_276), PWN(PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275), Add_277)) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 713 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: r1o copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] RESIZE: Resize_280 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 736 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 389 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_290 + Relu_291 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_292 + Relu_293 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_294 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 753 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 754 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_302 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] ELEMENTWISE: Mul_303 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_304 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(Mul_305, Sub_306) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] COPY: 765 copy [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_312 + Relu_313 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_314 + Relu_315 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_316 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(Mul_317, Sub_318) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] RESIZE: Resize_332 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] RESIZE: Resize_346 [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(Mul_347, Add_348) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_350, PWN(Clip_351)) [02/13/2023-19:50:02] [I] [TRT] [GpuLayer] POINTWISE: PWN(Clip_352) [02/13/2023-19:50:03] [V] [TRT] Using cublasLt as a tactic source [02/13/2023-19:50:03] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +535, GPU +810, now: CPU 1163, GPU 9572 (MiB) [02/13/2023-19:50:03] [V] [TRT] Using cuDNN as a tactic source [02/13/2023-19:50:04] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +85, GPU +135, now: CPU 1248, GPU 9707 (MiB) [02/13/2023-19:50:04] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored. [02/13/2023-19:50:04] [V] [TRT] Constructing optimization profile number 0 [1/1]. [02/13/2023-19:50:04] [V] [TRT] Reserving memory for host IO tensors. Host: 0 bytes [02/13/2023-19:50:04] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:04] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:50:04] [V] [TRT] --------------- Timing Runner: Reformatting CopyNode for Network Input src (Reformat) [02/13/2023-19:50:04] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.54382 [02/13/2023-19:50:04] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.22753 [02/13/2023-19:50:04] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.34001 [02/13/2023-19:50:04] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.34001 [02/13/2023-19:50:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:04] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(11059200,1,7680,3) *************** [02/13/2023-19:50:04] [V] [TRT] --------------- Timing Runner: Reformatting CopyNode for Network Input src (Reformat) [02/13/2023-19:50:04] [V] [TRT] Tactic: 0x00000000000003e8 Time: 2.31252 [02/13/2023-19:50:04] [V] [TRT] Tactic: 0x00000000000003ea Time: 4.16845 [02/13/2023-19:50:04] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.31242 [02/13/2023-19:50:04] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 2.31242 [02/13/2023-19:50:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:04] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:50:04] [V] [TRT] --------------- Timing Runner: Reformatting CopyNode for Network Input src (Reformat) [02/13/2023-19:50:04] [V] [TRT] Tactic: 0x00000000000003e8 Time: 5.28607 [02/13/2023-19:50:04] [V] [TRT] Tactic: 0x00000000000003ea Time: 3.91419 [02/13/2023-19:50:04] [V] [TRT] Tactic: 0x0000000000000000 Time: 5.49553 [02/13/2023-19:50:04] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 3.91419 [02/13/2023-19:50:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:04] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:50:04] [V] [TRT] --------------- Timing Runner: Reformatting CopyNode for Network Input src (Reformat) [02/13/2023-19:50:06] [V] [TRT] Tactic: 0x00000000000003e8 Time: 210.365 [02/13/2023-19:50:06] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.18294 [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x0000000000000000 Time: 87.1459 [02/13/2023-19:50:07] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 9.18294 [02/13/2023-19:50:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:07] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:50:07] [V] [TRT] --------------- Timing Runner: Reformatting CopyNode for Network Input src (Reformat) [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.74438 [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.71829 [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.71791 [02/13/2023-19:50:07] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 2.71829 [02/13/2023-19:50:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:07] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:07] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(3,1,3,3) *************** [02/13/2023-19:50:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> (Unnamed Layer* 2) [Shuffle]_output) (Reformat) [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00496047 [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114993 [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00532351 [02/13/2023-19:50:07] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00496047 [02/13/2023-19:50:07] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(1,1:4,1,1) *************** [02/13/2023-19:50:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> (Unnamed Layer* 2) [Shuffle]_output) (Reformat) [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00496883 [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109685 [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00492099 [02/13/2023-19:50:07] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00492099 [02/13/2023-19:50:07] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(1,1:32,1,1) *************** [02/13/2023-19:50:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> (Unnamed Layer* 2) [Shuffle]_output) (Reformat) [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00481737 [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01077 [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00503204 [02/13/2023-19:50:07] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00481737 [02/13/2023-19:50:07] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> (Unnamed Layer* 2) [Shuffle]_output) (Reformat) [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00468158 [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109646 [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00487421 [02/13/2023-19:50:07] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00468158 [02/13/2023-19:50:07] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:07] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(3,1,3,3) *************** [02/13/2023-19:50:07] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(1,1:4,1,1) *************** [02/13/2023-19:50:07] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(1,1:32,1,1) *************** [02/13/2023-19:50:07] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:07] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:07] [V] [TRT] *************** Autotuning Reformat: Float(11059200,1,7680,3) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:50:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:50:07] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.976334 [02/13/2023-19:50:08] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.02244 [02/13/2023-19:50:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.990331 [02/13/2023-19:50:08] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.976334 [02/13/2023-19:50:08] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:50:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:50:08] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.21337 [02/13/2023-19:50:08] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.0208 [02/13/2023-19:50:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.25734 [02/13/2023-19:50:08] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.21337 [02/13/2023-19:50:08] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:50:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:50:08] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.11992 [02/13/2023-19:50:08] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.02004 [02/13/2023-19:50:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.54298 [02/13/2023-19:50:08] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 3.11992 [02/13/2023-19:50:08] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:50:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:50:08] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.28617 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 26.489 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.27286 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.27286 [02/13/2023-19:50:09] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(442368,1,1536,3) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 389) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0275985 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0447623 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.027648 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0275985 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 389) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.052768 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0423909 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.056128 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0423909 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 389) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.45466 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.375419 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.45429 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.375419 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 389) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.141319 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.115465 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.14008 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.115465 [02/13/2023-19:50:09] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(11059200,1,7680,3) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:50:09] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:09] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0544853 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0422777 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.05472 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0422777 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0248015 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.368041 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0245318 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0245318 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0536381 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.357376 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0509409 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0509409 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0297554 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.367703 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0298578 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0297554 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.142907 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.369065 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.128347 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.128347 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.102025 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.362519 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.101189 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.101189 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0527558 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.06842 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0526141 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0526141 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0998971 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.52807 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.100507 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0998971 [02/13/2023-19:50:09] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(2174976,36864,256,1) -> Float(2174976,1,15104,59) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 602) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217763 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0287168 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0216673 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0216673 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(2174976,36864,256,1) -> Float(552960,1:4,3840,15) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 602) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0432171 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0205316 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0430114 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0205316 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(552960,1:4,3840,15) -> Float(2174976,36864,256,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 602) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0109012 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.096432 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.011194 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0109012 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(552960,1:4,3840,15) -> Float(2174976,1,15104,59) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 602) (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0231621 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0921509 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229708 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0229708 [02/13/2023-19:50:09] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:09] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:09] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.484096 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.64667 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.550949 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.484096 [02/13/2023-19:50:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.15255 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.19148 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.15903 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.15255 [02/13/2023-19:50:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.15649 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.18324 [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.14353 [02/13/2023-19:50:09] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.14353 [02/13/2023-19:50:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:09] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:50:09] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.88128 [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.28699 [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.88044 [02/13/2023-19:50:10] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 2.28699 [02/13/2023-19:50:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:10] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:50:10] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x00000000000003e8 Time: 2.14897 [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x00000000000003ea Time: 3.07754 [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.14216 [02/13/2023-19:50:10] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 2.14216 [02/13/2023-19:50:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:10] [V] [TRT] *************** Autotuning Reformat: Float(11059200,1,7680,3) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:50:10] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.983401 [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.02248 [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.02003 [02/13/2023-19:50:10] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.983401 [02/13/2023-19:50:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:10] [V] [TRT] *************** Autotuning Reformat: Float(11059200,1,7680,3) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:50:10] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.02556 [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.6723 [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.02438 [02/13/2023-19:50:10] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.02438 [02/13/2023-19:50:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:10] [V] [TRT] *************** Autotuning Reformat: Float(11059200,1,7680,3) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:50:10] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.02264 [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.6691 [02/13/2023-19:50:10] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.02203 [02/13/2023-19:50:10] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.02203 [02/13/2023-19:50:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:10] [V] [TRT] *************** Autotuning Reformat: Float(11059200,1,7680,3) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:50:10] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:11] [V] [TRT] Tactic: 0x00000000000003e8 Time: 4.15185 [02/13/2023-19:50:11] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.6706 [02/13/2023-19:50:11] [V] [TRT] Tactic: 0x0000000000000000 Time: 4.17643 [02/13/2023-19:50:11] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 4.15185 [02/13/2023-19:50:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:11] [V] [TRT] *************** Autotuning Reformat: Float(11059200,1,7680,3) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:50:11] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:11] [V] [TRT] Tactic: 0x00000000000003e8 Time: 2.89282 [02/13/2023-19:50:12] [V] [TRT] Tactic: 0x00000000000003ea Time: 61.5456 [02/13/2023-19:50:12] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.923 [02/13/2023-19:50:12] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 2.89282 [02/13/2023-19:50:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:12] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:50:12] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:12] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.17754 [02/13/2023-19:50:12] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.02307 [02/13/2023-19:50:12] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.16043 [02/13/2023-19:50:12] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.16043 [02/13/2023-19:50:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:12] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:50:12] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:12] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.17459 [02/13/2023-19:50:12] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.68946 [02/13/2023-19:50:12] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.16968 [02/13/2023-19:50:12] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.16968 [02/13/2023-19:50:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:12] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:50:12] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:12] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.17075 [02/13/2023-19:50:12] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.70001 [02/13/2023-19:50:12] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.17057 [02/13/2023-19:50:12] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.17057 [02/13/2023-19:50:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:12] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:50:12] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:12] [V] [TRT] Tactic: 0x00000000000003e8 Time: 4.25141 [02/13/2023-19:50:13] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.69235 [02/13/2023-19:50:13] [V] [TRT] Tactic: 0x0000000000000000 Time: 4.35775 [02/13/2023-19:50:13] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 4.25141 [02/13/2023-19:50:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:13] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:50:13] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:13] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.12283 [02/13/2023-19:50:13] [V] [TRT] Tactic: 0x00000000000003ea Time: 61.5371 [02/13/2023-19:50:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.15399 [02/13/2023-19:50:14] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 3.12283 [02/13/2023-19:50:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:14] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:50:14] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:14] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.10851 [02/13/2023-19:50:14] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.02582 [02/13/2023-19:50:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.12032 [02/13/2023-19:50:14] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 3.10851 [02/13/2023-19:50:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:14] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:50:14] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:14] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.86325 [02/13/2023-19:50:14] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.69195 [02/13/2023-19:50:15] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.71323 [02/13/2023-19:50:15] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.71323 [02/13/2023-19:50:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:15] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:50:15] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:15] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.85226 [02/13/2023-19:50:15] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.69168 [02/13/2023-19:50:15] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.7008 [02/13/2023-19:50:15] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.7008 [02/13/2023-19:50:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:15] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:50:15] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:15] [V] [TRT] Tactic: 0x00000000000003e8 Time: 5.97739 [02/13/2023-19:50:16] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.68976 [02/13/2023-19:50:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 6.00184 [02/13/2023-19:50:16] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 5.97739 [02/13/2023-19:50:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:16] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:50:16] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:16] [V] [TRT] Tactic: 0x00000000000003e8 Time: 5.94242 [02/13/2023-19:50:17] [V] [TRT] Tactic: 0x00000000000003ea Time: 61.3741 [02/13/2023-19:50:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 5.94763 [02/13/2023-19:50:17] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 5.94242 [02/13/2023-19:50:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:17] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:50:17] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:17] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.24332 [02/13/2023-19:50:17] [V] [TRT] Tactic: 0x00000000000003ea Time: 26.4892 [02/13/2023-19:50:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.3003 [02/13/2023-19:50:18] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.24332 [02/13/2023-19:50:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:18] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:50:18] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:18] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.82513 [02/13/2023-19:50:18] [V] [TRT] Tactic: 0x00000000000003ea Time: 61.5609 [02/13/2023-19:50:18] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.79677 [02/13/2023-19:50:18] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.79677 [02/13/2023-19:50:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:18] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:50:18] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:18] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.81552 [02/13/2023-19:50:19] [V] [TRT] Tactic: 0x00000000000003ea Time: 61.5601 [02/13/2023-19:50:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.83454 [02/13/2023-19:50:19] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.81552 [02/13/2023-19:50:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:19] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:50:19] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:19] [V] [TRT] Tactic: 0x00000000000003e8 Time: 4.44206 [02/13/2023-19:50:20] [V] [TRT] Tactic: 0x00000000000003ea Time: 61.5425 [02/13/2023-19:50:20] [V] [TRT] Tactic: 0x0000000000000000 Time: 4.229 [02/13/2023-19:50:20] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 4.229 [02/13/2023-19:50:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:20] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:50:20] [V] [TRT] --------------- Timing Runner: src copy (Reformat) [02/13/2023-19:50:20] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.26083 [02/13/2023-19:50:20] [V] [TRT] Tactic: 0x00000000000003ea Time: 25.4492 [02/13/2023-19:50:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.25984 [02/13/2023-19:50:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 3.25984 [02/13/2023-19:50:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:21] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:21] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:50:21] [V] [TRT] --------------- Timing Runner: 755 copy (Reformat) [02/13/2023-19:50:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.200617 [02/13/2023-19:50:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.220882 [02/13/2023-19:50:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.196603 [02/13/2023-19:50:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.196603 [02/13/2023-19:50:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:21] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:50:21] [V] [TRT] --------------- Timing Runner: 755 copy (Reformat) [02/13/2023-19:50:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.722144 [02/13/2023-19:50:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.0373 [02/13/2023-19:50:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.702752 [02/13/2023-19:50:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.702752 [02/13/2023-19:50:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:21] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:50:21] [V] [TRT] --------------- Timing Runner: 755 copy (Reformat) [02/13/2023-19:50:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.735758 [02/13/2023-19:50:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.03413 [02/13/2023-19:50:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.722437 [02/13/2023-19:50:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.722437 [02/13/2023-19:50:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:21] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:50:21] [V] [TRT] --------------- Timing Runner: 755 copy (Reformat) [02/13/2023-19:50:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 80.6536 [02/13/2023-19:50:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.10863 [02/13/2023-19:50:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 81.7712 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 9.10863 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 755 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.20293 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.911767 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.2111 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.911767 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:23] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(2174976,36864,256,1) -> Float(552960,1:4,3840,15) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(602 -> ) (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157051 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0138523 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0156512 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0138523 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(2174976,1,15104,59) -> Float(2174976,36864,256,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(602 -> ) (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0253493 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0981966 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0245821 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0245821 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(2174976,1,15104,59) -> Float(552960,1:4,3840,15) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(602 -> ) (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0226991 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0969097 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0225345 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0225345 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(552960,1:4,3840,15) -> Float(2174976,36864,256,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(602 -> ) (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0247947 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0982903 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0262895 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0247947 [02/13/2023-19:50:23] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(986112,9216,128,1) -> Float(986112,1,13696,107) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 603) (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0069945 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122095 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00715276 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0069945 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(986112,9216,128,1) -> Float(248832,1:4,3456,27) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 603) (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0155822 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109296 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0150715 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0109296 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(248832,1:4,3456,27) -> Float(986112,9216,128,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 603) (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00604762 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.028576 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00581577 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00581577 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(248832,1:4,3456,27) -> Float(986112,1,13696,107) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 603) (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00692593 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0281432 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00727611 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00692593 [02/13/2023-19:50:23] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0121029 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0305125 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0122667 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0121029 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0360229 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0452309 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0342958 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0342958 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0320466 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0453646 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0319945 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0319945 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.17397 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0938674 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.159589 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0938674 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0249029 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.368023 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0247162 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0247162 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0284663 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.350171 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0290304 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0284663 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0306002 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.350254 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0303003 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0303003 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.167717 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.350373 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.133874 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.133874 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0288704 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.368 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0290222 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0288704 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0373234 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.3528 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0395063 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0373234 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0370869 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.352229 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0374366 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0370869 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.18315 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.351963 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.179191 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.179191 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.136962 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.368128 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.145417 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.136962 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0679787 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.356635 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0673082 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0673082 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0678674 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.356078 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0683581 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0678674 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.198057 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.355776 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.199941 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.198057 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0528808 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.06731 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0529265 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0528808 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0791749 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.46855 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0795429 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0791749 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0790126 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.46913 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0799269 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0790126 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 389 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.208201 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.46996 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.201513 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.201513 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:23] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 757 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00880323 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0139836 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00700517 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00700517 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 757 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0147886 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0438423 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0144887 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0144887 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 757 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0156475 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0439326 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157371 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0156475 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: 757 copy (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.22312 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.373102 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.22569 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.373102 [02/13/2023-19:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:23] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(442368,1,1536,3) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.026269 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0438754 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0262476 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0262476 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.44828 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.375465 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.44784 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.375465 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.138354 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.116176 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.138338 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.116176 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.46171 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.362103 [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.45723 [02/13/2023-19:50:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.362103 [02/13/2023-19:50:23] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.277321 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.53278 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.281989 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.277321 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(442368,1,1536,3) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0323995 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.352777 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0323337 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0323337 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.48586 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.363177 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.48554 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.363177 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.299392 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.53351 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.295355 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.295355 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(442368,1,1536,3) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0443246 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.355584 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0446491 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0443246 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.397627 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.53358 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.397184 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.397184 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(442368,1,1536,3) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.053347 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.46916 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0534552 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.053347 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(389 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.48693 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 22.5328 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.48739 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 3.48693 [02/13/2023-19:50:24] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(3,1,3,3) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00967832 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0264137 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0102194 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00967832 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(1,1:4,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0103167 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.026189 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0106096 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0103167 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(1,1:32,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00988983 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0253867 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0105835 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00988983 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0103987 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0256899 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0109985 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0103987 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,3,3) -> Float(3,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.010084 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0266743 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00971368 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00971368 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,3,3) -> Float(1,1:4,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00934943 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0235494 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00898743 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00898743 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,3,3) -> Float(1,1:32,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00858703 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0212232 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00937714 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00858703 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,3,3) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00754286 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020977 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0083454 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00754286 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:4,1,1) -> Float(3,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00717577 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.019372 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0078068 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00717577 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:4,1,1) -> Float(3,1,3,3) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00633103 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0178194 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00683429 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00633103 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:4,1,1) -> Float(1,1:32,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00612971 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0168178 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00640596 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00612971 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:4,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00584338 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0152151 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00593262 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00584338 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:32,1,1) -> Float(3,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00546963 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0139936 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00576768 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00546963 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:32,1,1) -> Float(3,1,3,3) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00519102 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127992 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00513747 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00513747 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:32,1,1) -> Float(1,1:4,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00495401 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117749 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00513796 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00495401 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:32,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00469854 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108216 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00476724 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00469854 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(3,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00471049 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110896 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00478491 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00471049 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(3,1,3,3) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00463351 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106991 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004599 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.004599 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(1,1:4,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00479482 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108473 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0048317 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00479482 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(1,1:32,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 2) [Shuffle]_output -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00475075 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011084 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00495228 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00475075 [02/13/2023-19:50:24] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(3,1,3,3) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(1,1:4,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(1,1:32,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,3,3) -> Float(3,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,3,3) -> Float(1,1:4,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,3,3) -> Float(1,1:32,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(3,1,3,3) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:4,1,1) -> Float(3,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:4,1,1) -> Float(3,1,3,3) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:4,1,1) -> Float(1,1:32,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:4,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:32,1,1) -> Float(3,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:32,1,1) -> Float(3,1,3,3) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:32,1,1) -> Float(1,1:4,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1,1:32,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(3,1,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(3,1,3,3) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(1,1:4,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(1,1:32,1,1) *************** [02/13/2023-19:50:24] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(986112,9216,128,1) -> Float(248832,1:4,3456,27) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(603 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00685105 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104976 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00694487 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00685105 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(986112,1,13696,107) -> Float(986112,9216,128,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(603 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00774665 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0286245 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00762322 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00762322 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(986112,1,13696,107) -> Float(248832,1:4,3456,27) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(603 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00722834 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0286042 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.007152 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.007152 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(248832,1:4,3456,27) -> Float(986112,9216,128,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(603 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00755489 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0286171 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00764247 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00755489 [02/13/2023-19:50:24] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(393984,2304,64,1) -> Float(393984,1,10944,171) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 604) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00504623 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107977 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00485211 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00485211 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(393984,2304,64,1) -> Float(99072,1:4,2752,43) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 604) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00724091 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010562 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00707048 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00707048 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(99072,1:4,2752,43) -> Float(393984,2304,64,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 604) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00477486 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130718 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00501296 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00477486 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(99072,1:4,2752,43) -> Float(393984,1,10944,171) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 604) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00510408 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129661 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0050746 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0050746 [02/13/2023-19:50:24] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(758 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0416857 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0443291 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0415737 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0415737 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(758 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0459349 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0427909 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0482926 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0427909 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(758 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0318501 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.373157 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0315557 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0315557 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(758 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0436754 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.37349 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0432114 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0432114 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(758 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0368571 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.373856 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0370309 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0368571 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(758 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.042304 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.373321 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0426423 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.042304 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(758 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.159506 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.373563 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.183639 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.159506 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(758 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0495924 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.376485 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0496198 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0495924 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(758 -> ) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0521768 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.375872 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.052352 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0521768 [02/13/2023-19:50:24] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 760) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0432766 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0447029 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0406914 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0406914 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 760) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0441486 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0442331 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0442949 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0441486 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 760) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.38913 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.374894 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.39515 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.374894 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 760) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.192178 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.152357 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.194021 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.152357 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 760) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0328183 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.371854 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0328375 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0328183 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 760) (Reformat) [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0419897 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.37467 [02/13/2023-19:50:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0419326 [02/13/2023-19:50:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0419326 [02/13/2023-19:50:24] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 760) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.40047 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.376992 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.39745 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.376992 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 760) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.391881 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.57803 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.391081 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.391081 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 760) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0369554 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.372786 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0386023 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0369554 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 760) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0426926 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.374034 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0432103 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0426926 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 760) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.42563 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.37744 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.39144 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.37744 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 760) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.391488 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.57949 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.393047 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.391488 [02/13/2023-19:50:25] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(758 -> ) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.39083 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.37536 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.39333 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.37536 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(758 -> ) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.43844 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377705 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.41575 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.377705 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(758 -> ) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.41975 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377472 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.39996 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.377472 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(442368,1,1536,3) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(442368,1,1536,3) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(442368,1,1536,3) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(442368,1,1536,3) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(760 -> ) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.194729 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.152 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.188389 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.152 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(760 -> ) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.395913 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.579 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.394075 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.394075 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(760 -> ) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.394688 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.57973 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.390651 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.390651 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(760 -> ) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.527493 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.57873 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.526135 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.526135 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(760 -> ) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0675992 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.42124 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0677135 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0675992 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(760 -> ) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0682423 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.52213 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0687573 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0682423 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(760 -> ) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0688396 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.52284 [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0684526 [02/13/2023-19:50:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0684526 [02/13/2023-19:50:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(760 -> ) (Reformat) [02/13/2023-19:50:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.43828 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 22.533 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.44014 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 3.43828 [02/13/2023-19:50:26] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(3538944,147456,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0777486 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0728846 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0810788 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0728846 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(3538944,147456,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0803543 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0761234 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0814057 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0761234 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(3538944,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.228128 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0701471 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.226158 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0701471 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(3538944,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.114939 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.161234 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.112402 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.112402 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(3538944,1,12288,24) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0334574 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.372014 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.033301 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.033301 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(3538944,1,12288,24) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.073296 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.373408 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.073136 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.073136 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(3538944,1,12288,24) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.236942 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.370953 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.236443 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.236443 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(3538944,1,12288,24) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.128629 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.51709 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.135296 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.128629 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(884736,1:4,3072,6) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0387109 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.371127 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0383943 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0383943 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(884736,1:4,3072,6) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0725234 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.371918 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0739451 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0725234 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(884736,1:4,3072,6) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.214053 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.371621 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.221787 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.214053 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(884736,1:4,3072,6) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.13421 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.50313 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.134165 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.134165 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.192896 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.373294 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.197961 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.192896 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0964297 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377445 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0969143 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0964297 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0968549 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377152 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0963177 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0963177 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.268064 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.376914 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.266528 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.266528 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.28736 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.50603 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.289509 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.28736 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0676175 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.42073 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.067555 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.067555 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.120491 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.52257 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.121008 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.120491 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.120695 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.52239 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.120448 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.120448 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 769) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.260814 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.52244 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.266743 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.260814 [02/13/2023-19:50:26] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.043272 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0452949 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0432183 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0432183 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0551025 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0425851 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.051651 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0425851 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.64421 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100683 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.649577 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100683 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.194377 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.151529 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.191195 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.151529 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0424149 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0999291 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0427543 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0424149 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0430354 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0991406 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.042904 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.042904 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.682199 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100773 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.685225 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100773 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.404736 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.645029 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.405353 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.404736 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0438309 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.10027 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0439703 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0438309 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.042496 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100569 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0421577 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0421577 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.700453 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101342 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.695826 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101342 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.406898 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.645413 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.403127 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.403127 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.105472 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100288 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.106299 [02/13/2023-19:50:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100288 [02/13/2023-19:50:26] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0438891 [02/13/2023-19:50:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101015 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0440411 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0438891 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0492099 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100855 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0496503 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0492099 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.503278 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.645143 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.515794 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.503278 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0676785 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.42181 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0676952 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0676785 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0737234 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.634949 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0765577 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0737234 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0769989 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.634706 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0765074 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0765074 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(823 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.737065 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 5.6456 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.713349 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.713349 [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0499017 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0448777 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0497676 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0448777 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.048829 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0432057 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0464869 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0432057 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.658505 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100528 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.660896 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100528 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.18907 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.152507 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.187049 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.152507 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0423554 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.098064 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0425406 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0423554 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0419349 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0990629 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0411291 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0411291 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.691735 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101271 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.691296 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101271 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.401189 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.644658 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.428791 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.401189 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0437371 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0985486 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0437806 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0437371 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0432137 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0987771 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0435131 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0432137 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.716896 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101022 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.712247 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101022 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.404457 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.644859 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.403337 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.403337 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.125486 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100377 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.113803 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100377 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0443291 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100677 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.044528 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0443291 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0489752 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0998263 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0489646 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0489646 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.507918 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.645682 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.528229 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.507918 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0674789 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.42174 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0674575 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0674575 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.076384 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.634514 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0748869 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0748869 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0779589 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.634697 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0747177 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0747177 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 397) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.706679 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 5.64571 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.705531 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.705531 [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(2359296,36864,256,1) -> Float(2359296,1,16384,64) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(406 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.315762 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.109906 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.313957 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.109906 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(2359296,36864,256,1) -> Float(589824,1:4,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(406 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.317495 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.110338 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.316823 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.110338 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(2359296,1,16384,64) -> Float(2359296,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(406 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.584128 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.113552 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.573134 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.113552 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(2359296,1,16384,64) -> Float(589824,1:4,4096,16) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(406 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.155922 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.112043 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.156183 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.112043 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1:4,4096,16) -> Float(2359296,36864,256,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(406 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.621435 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.113074 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.521595 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.113074 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1:4,4096,16) -> Float(2359296,1,16384,64) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(406 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.15659 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.112935 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.156023 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.112935 [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,9216,128,1) -> Float(589824,1,8192,64) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(409 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0844457 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0318848 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0836777 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0318848 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,9216,128,1) -> Float(147456,1:4,2048,16) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(409 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0857989 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0319223 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0863474 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0319223 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,8192,64) -> Float(589824,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(409 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0618438 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0316352 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.061376 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0316352 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,8192,64) -> Float(147456,1:4,2048,16) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(409 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0430731 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0319515 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0417657 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0319515 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,2048,16) -> Float(589824,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(409 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0614156 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0336466 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0614888 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0336466 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,2048,16) -> Float(589824,1,8192,64) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(409 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0401714 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0319159 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0428377 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0319159 [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,9216,128,1) -> Float(221184,1,3072,24) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 838) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.020561 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0289701 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0204421 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0204421 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,9216,128,1) -> Float(55296,1:4,768,6) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 838) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0208803 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0293879 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209143 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0208803 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,1,3072,24) -> Float(221184,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 838) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0202737 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0290917 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0204976 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0202737 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,1,3072,24) -> Float(55296,1:4,768,6) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 838) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0170626 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0287643 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0172983 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0170626 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(55296,1:4,768,6) -> Float(221184,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 838) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0203246 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0293339 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0204088 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0203246 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(55296,1:4,768,6) -> Float(221184,1,3072,24) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 838) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0172135 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0288165 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0173374 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0172135 [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,9216,128,1) -> Float(221184,1,3072,24) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(838 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0204715 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0293266 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0204944 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0204715 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,9216,128,1) -> Float(55296,1:4,768,6) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(838 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0208111 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0291566 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209691 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0208111 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,1,3072,24) -> Float(221184,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(838 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0204989 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0290935 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0206393 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0204989 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,1,3072,24) -> Float(55296,1:4,768,6) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(838 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0173806 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0287808 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0173298 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0173298 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(55296,1:4,768,6) -> Float(221184,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(838 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0204807 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0291401 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0206152 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0204807 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(55296,1:4,768,6) -> Float(221184,1,3072,24) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(838 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0170921 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0286939 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0172246 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0170921 [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(663552,9216,128,1) -> Float(663552,1,9216,72) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(414 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.097952 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.052739 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0981463 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.052739 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(663552,9216,128,1) -> Float(165888,1:4,2304,18) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(414 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.099232 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0530712 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.098624 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0530712 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(663552,1,9216,72) -> Float(663552,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(414 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0694004 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0550918 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0687436 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0550918 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(663552,1,9216,72) -> Float(165888,1:4,2304,18) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(414 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0479451 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0514499 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0483352 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0479451 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,1:4,2304,18) -> Float(663552,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(414 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0697295 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0555611 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.069469 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0555611 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,1:4,2304,18) -> Float(663552,1,9216,72) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(414 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0484876 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0515276 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0480091 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0480091 [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(663552,9216,128,1) -> Float(663552,1,9216,72) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(663552,9216,128,1) -> Float(165888,1:4,2304,18) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(663552,1,9216,72) -> Float(663552,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(663552,1,9216,72) -> Float(165888,1:4,2304,18) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,1:4,2304,18) -> Float(663552,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,1:4,2304,18) -> Float(663552,1,9216,72) *************** [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,9216,128,1) -> Float(221184,1,3072,24) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,9216,128,1) -> Float(55296,1:4,768,6) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,1,3072,24) -> Float(221184,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,1,3072,24) -> Float(55296,1:4,768,6) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(55296,1:4,768,6) -> Float(221184,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(55296,1:4,768,6) -> Float(221184,1,3072,24) *************** [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,9216,128,1) -> Float(221184,1,3072,24) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,9216,128,1) -> Float(55296,1:4,768,6) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,1,3072,24) -> Float(221184,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,1,3072,24) -> Float(55296,1:4,768,6) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(55296,1:4,768,6) -> Float(221184,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(55296,1:4,768,6) -> Float(221184,1,3072,24) *************** [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,9216,128,1) -> Float(221184,1,3072,24) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,9216,128,1) -> Float(55296,1:4,768,6) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,1,3072,24) -> Float(221184,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(221184,1,3072,24) -> Float(55296,1:4,768,6) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(55296,1:4,768,6) -> Float(221184,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(55296,1:4,768,6) -> Float(221184,1,3072,24) *************** [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(663552,9216,128,1) -> Float(663552,1,9216,72) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(663552,9216,128,1) -> Float(165888,1:4,2304,18) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(663552,1,9216,72) -> Float(663552,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(663552,1,9216,72) -> Float(165888,1:4,2304,18) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,1:4,2304,18) -> Float(663552,9216,128,1) *************** [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,1:4,2304,18) -> Float(663552,1,9216,72) *************** [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,2304,64,1) -> Float(165888,1,4608,72) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 426) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.015971 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179954 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0159639 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0159639 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,2304,64,1) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 426) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0160914 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0181931 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0160249 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0160249 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 426) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0821006 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0181434 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0821486 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0181434 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 426) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0374034 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0461326 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0372766 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0372766 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,1,4608,72) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 426) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0193251 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182063 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0194663 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182063 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,1,4608,72) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 426) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0140235 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173135 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0140048 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0140048 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,1,4608,72) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 426) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0907109 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0175695 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0908206 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0175695 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,1,4608,72) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 426) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0973326 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0828 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.096672 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0828 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(41472,1:4,1152,18) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 426) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0191834 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182697 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0191703 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182697 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(41472,1:4,1152,18) -> Float(165888,1,4608,72) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 426) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0140335 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172795 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138556 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0138556 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(41472,1:4,1152,18) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 426) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0898423 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173476 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0903749 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173476 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(41472,1:4,1152,18) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 426) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.096464 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0828069 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0967634 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0828069 [02/13/2023-19:50:27] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,2304,64,1) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0160879 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179651 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0160361 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0160361 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,1,4608,72) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0195086 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182943 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0197217 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182943 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(165888,1,4608,72) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0139225 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0175858 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139034 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0139034 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(41472,1:4,1152,18) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0195223 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0183126 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0195731 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0183126 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0199606 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0183469 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.019796 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0183469 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0160279 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173394 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0161138 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0160279 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138024 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.405065 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137168 [02/13/2023-19:50:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0137168 [02/13/2023-19:50:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.049501 [02/13/2023-19:50:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.713536 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0498072 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.049501 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(72,1,1,1) -> Float(72,1,72,72) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(427 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00576549 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145038 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0056524 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0056524 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(72,1,1,1) -> Float(18,1:4,18,18) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(427 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00552123 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132916 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00549872 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00549872 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(72,1,72,72) -> Float(72,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(427 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00503362 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123486 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00520327 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00503362 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(72,1,72,72) -> Float(18,1:4,18,18) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(427 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00475561 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119349 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00484282 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00475561 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(18,1:4,18,18) -> Float(72,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(427 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00469604 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111859 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0047677 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00469604 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(18,1:4,18,18) -> Float(72,1,72,72) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(427 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0046223 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109992 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00473629 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0046223 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(24,1,1,1) -> Float(24,1,24,24) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(429 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00454971 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108617 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00478781 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00454971 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(24,1,1,1) -> Float(6,1:4,6,6) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(429 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00459014 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011142 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00477486 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00459014 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(24,1,24,24) -> Float(24,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(429 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00465755 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107037 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00491139 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00465755 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(24,1,24,24) -> Float(6,1:4,6,6) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(429 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00455329 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011175 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00480137 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00455329 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(6,1:4,6,6) -> Float(24,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(429 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00456329 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110762 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00477608 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00456329 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(6,1:4,6,6) -> Float(24,1,24,24) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(429 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00468689 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010816 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00469029 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00468689 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(72,1,1,1) -> Float(72,1,72,72) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(72,1,1,1) -> Float(18,1:4,18,18) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(72,1,1,1) -> Float(3,1:32,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00463897 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111012 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00479848 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00463897 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(72,1,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00478232 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107863 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0049155 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00478232 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(72,1,72,72) -> Float(72,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(72,1,72,72) -> Float(18,1:4,18,18) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(72,1,72,72) -> Float(3,1:32,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00465902 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110069 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00488488 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00465902 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(72,1,72,72) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00477623 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112689 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00494739 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00477623 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(18,1:4,18,18) -> Float(72,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(18,1:4,18,18) -> Float(72,1,72,72) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(18,1:4,18,18) -> Float(3,1:32,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00480731 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108584 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00490514 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00480731 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(18,1:4,18,18) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00467716 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108395 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00500083 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00467716 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(3,1:32,1,1) -> Float(72,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00461036 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108924 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0048288 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00461036 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(3,1:32,1,1) -> Float(72,1,72,72) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00462171 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010753 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00465947 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00462171 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(3,1:32,1,1) -> Float(18,1:4,18,18) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00461596 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109904 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00486796 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00461596 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(3,1:32,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00466536 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114022 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00497955 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00466536 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(72,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00472111 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107589 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00491352 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00472111 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(72,1,72,72) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00463749 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108846 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00471226 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00463749 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(18,1:4,18,18) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00466183 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109525 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00475561 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00466183 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(3,1:32,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(430 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00479223 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109336 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00488884 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00479223 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(165888,2304,64,1) -> Float(165888,1,4608,72) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0158908 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0180611 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.015933 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0158908 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(165888,2304,64,1) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(165888,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0822651 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018264 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.081968 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.018264 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(165888,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.037 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0461051 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0368343 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0368343 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(165888,1,4608,72) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(165888,1,4608,72) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(165888,1,4608,72) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0903246 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173836 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.090928 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173836 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(165888,1,4608,72) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0964 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0831749 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0971657 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0831749 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(41472,1:4,1152,18) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(41472,1:4,1152,18) -> Float(165888,1,4608,72) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138901 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017438 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013915 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0138901 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(41472,1:4,1152,18) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0899657 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174908 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0904251 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174908 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(41472,1:4,1152,18) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0968046 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0824069 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0969874 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0824069 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(165888,1,4608,72) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0139761 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174004 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138847 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0138847 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0959383 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0824686 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0963703 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0824686 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(165888,1,4608,72) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0494004 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.712155 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0490682 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0490682 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(426 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0816411 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.71237 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0814606 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0814606 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(165888,2304,64,1) -> Float(165888,1,4608,72) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(165888,2304,64,1) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(165888,1,4608,72) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(165888,1,4608,72) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(41472,1:4,1152,18) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(41472,1:4,1152,18) -> Float(165888,1,4608,72) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(165888,1,4608,72) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(165888,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(165888,1,4608,72) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 856) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00956709 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013647 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00957257 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00956709 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 856) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00992183 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136137 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00983954 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00983954 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 856) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0135709 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133494 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0133939 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0133494 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 856) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00966126 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134957 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00967741 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00966126 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 856) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.013743 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133677 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013649 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0133677 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 856) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00966613 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132522 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00963078 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00963078 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(856 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00966735 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136644 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0096701 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00966735 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(856 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00985082 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133951 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00996236 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00985082 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(856 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0137351 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133951 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0135867 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0133951 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(856 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00961493 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132376 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00970362 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00961493 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(856 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0137521 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0135701 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136706 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0135701 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(856 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00962042 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013489 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00977737 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00962042 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(437 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0287817 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182617 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0289381 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182617 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(437 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0316608 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182994 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0310409 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182994 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(437 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0293138 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0185629 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0292599 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0185629 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(437 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.020606 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0175675 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209443 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0175675 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(437 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0293851 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0188863 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.029515 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0188863 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(437 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0208464 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017281 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0205473 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017281 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 440) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0290514 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182331 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0285448 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182331 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 440) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.030592 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0184594 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0325742 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0184594 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 440) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0744571 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171784 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0741531 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0171784 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 440) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0799063 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0750171 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0774994 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0750171 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 440) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0291209 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018704 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0302336 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.018704 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 440) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0204304 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172851 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0205029 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0172851 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 440) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.088064 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0157751 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0885623 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0157751 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 440) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.167717 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.116233 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.164178 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.116233 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 440) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0285842 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0191543 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.029387 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0191543 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 440) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0206557 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173989 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0205309 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173989 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 440) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.08744 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.016095 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0871611 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.016095 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 440) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.165408 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.115657 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.162661 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.115657 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0282179 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0190691 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0289106 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0190691 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0234168 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171967 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0244709 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0171967 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0328274 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.670793 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0358423 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0328274 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0928983 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.714208 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.093008 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0928983 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(120,1,120,120) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(441 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00527625 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0139271 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0054488 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00527625 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(441 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00502053 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122202 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00516604 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00502053 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(120,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(441 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00477333 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113846 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0050694 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00477333 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(441 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00461655 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112063 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00473585 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00461655 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(120,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(441 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0046456 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108333 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00474205 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0046456 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(120,1,120,120) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(441 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00453186 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110815 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00477653 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00453186 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(32,1,1,1) -> Float(32,1,32,32) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(443 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00453771 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110098 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00478507 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00453771 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(32,1,1,1) -> Float(8,1:4,8,8) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(443 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00452829 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01104 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00482179 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00452829 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(32,1,32,32) -> Float(32,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(443 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00460314 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111884 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00485897 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00460314 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(32,1,32,32) -> Float(8,1:4,8,8) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(443 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00450229 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110516 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004832 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00450229 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(8,1:4,8,8) -> Float(32,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(443 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00460543 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107422 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0047363 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00460543 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(8,1:4,8,8) -> Float(32,1,32,32) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(443 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00452529 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111546 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00472007 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00452529 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(120,1,120,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(4,1:32,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0047155 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110157 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00488472 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0047155 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00480107 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109055 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00495779 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00480107 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(120,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(4,1:32,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0046953 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112373 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00480777 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0046953 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00489691 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108271 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00498932 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00489691 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(120,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(120,1,120,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(4,1:32,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0048541 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108372 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00495511 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0048541 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00474455 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110344 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0048547 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00474455 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(4,1:32,1,1) -> Float(120,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00461243 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110432 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00473099 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00461243 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(4,1:32,1,1) -> Float(120,1,120,120) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00458243 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011015 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00483124 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00458243 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(4,1:32,1,1) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00467156 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110885 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00483779 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00467156 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(4,1:32,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00485653 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107158 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00493131 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00485653 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(120,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00478187 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107125 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00480015 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00478187 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(120,1,120,120) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00452971 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109878 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00478507 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00452971 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00462422 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010736 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00478034 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00462422 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(4,1:32,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(444 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00466507 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01059 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00471078 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00466507 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.074128 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176081 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0739657 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0176081 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0816549 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0752617 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.082656 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0752617 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0880091 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0161854 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0884937 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0161854 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.165993 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.115909 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.164585 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.115909 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0872777 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0161661 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0872754 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0161661 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.164174 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.116249 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.163995 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.116249 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210998 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176543 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0203383 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0176543 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.167031 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.117413 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.17008 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.117413 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0905531 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.715483 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0922103 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0905531 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(440 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0886057 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.715077 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0883497 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0883497 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(120,1,120,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(120,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(120,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(120,1,120,120) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(32,1,1,1) -> Float(32,1,32,32) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(32,1,1,1) -> Float(8,1:4,8,8) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(32,1,32,32) -> Float(32,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(32,1,32,32) -> Float(8,1:4,8,8) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(8,1:4,8,8) -> Float(32,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(8,1:4,8,8) -> Float(32,1,32,32) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(120,1,120,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(4,1:32,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(120,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(4,1:32,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(120,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(120,1,120,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(4,1:32,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(4,1:32,1,1) -> Float(120,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(4,1:32,1,1) -> Float(120,1,120,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(4,1:32,1,1) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(4,1:32,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(120,1,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(120,1,120,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(4,1:32,1,1) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,7680,120) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,1920,30) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(9216,2304:32,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(276480,1,7680,120) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(552960,2304,64,1) -> Float(552960,1,15360,240) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0642103 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0308389 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0638613 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0308389 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(552960,2304,64,1) -> Float(138240,1:4,3840,60) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0599497 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0293641 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.060509 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0293641 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(552960,2304,64,1) -> Float(18432,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.147543 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0319406 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.148311 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0319406 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(552960,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.179104 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.14357 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.177143 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.14357 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,15360,240) -> Float(552960,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.053917 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0348279 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0536823 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0348279 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,15360,240) -> Float(138240,1:4,3840,60) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0406034 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0292581 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.041344 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0292581 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,15360,240) -> Float(18432,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.173221 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0291813 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.173993 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0291813 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,15360,240) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.364256 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.222016 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.363634 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.222016 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,3840,60) -> Float(552960,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0535512 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0319945 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0539962 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0319945 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,3840,60) -> Float(552960,1,15360,240) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0405497 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0291246 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0394571 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0291246 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,3840,60) -> Float(18432,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.172786 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.028099 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.173847 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.028099 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,3840,60) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.360494 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.221751 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.360206 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.221751 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(18432,2304:32,64,1) -> Float(552960,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0538194 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0338761 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0547611 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0338761 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(18432,2304:32,64,1) -> Float(552960,1,15360,240) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0421337 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0293467 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0405703 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0293467 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(18432,2304:32,64,1) -> Float(138240,1:4,3840,60) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0451943 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0324279 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0465326 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0324279 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(18432,2304:32,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.367438 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.224608 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.369243 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.224608 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(552960,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0643581 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.33231 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0639573 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0639573 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(552960,1,15360,240) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.196174 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.42079 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.193454 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.193454 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(138240,1:4,3840,60) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.194825 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.42096 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.197211 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.194825 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(18432,2304:32,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(877 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.172453 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.42091 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.172174 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.172174 [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(552960,2304,64,1) -> Float(552960,1,15360,240) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(552960,2304,64,1) -> Float(138240,1:4,3840,60) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,15360,240) -> Float(552960,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,15360,240) -> Float(138240,1:4,3840,60) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,3840,60) -> Float(552960,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,3840,60) -> Float(552960,1,15360,240) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(18432,2304:32,64,1) -> Float(552960,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(18432,2304:32,64,1) -> Float(552960,1,15360,240) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(18432,2304:32,64,1) -> Float(138240,1:4,3840,60) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(552960,2304,64,1) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(552960,1,15360,240) *************** [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(138240,1:4,3840,60) *************** [02/13/2023-19:50:28] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,576,32,1) -> Float(138240,1,7680,240) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.018004 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146647 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0179343 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0146647 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,576,32,1) -> Float(34560,1:4,1920,60) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0180234 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0153682 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0180777 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0153682 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,576,32,1) -> Float(4608,576:32,32,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0409989 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146181 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0410937 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0146181 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0317019 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0391714 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.03184 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0317019 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,1,7680,240) -> Float(138240,576,32,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0178709 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147122 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0176071 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0147122 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,1,7680,240) -> Float(34560,1:4,1920,60) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0123253 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0142105 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0121909 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0121909 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,1,7680,240) -> Float(4608,576:32,32,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0480975 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0143634 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0480137 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0143634 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(138240,1,7680,240) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0822446 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0432651 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0824983 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0432651 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(34560,1:4,1920,60) -> Float(138240,576,32,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0178686 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0142841 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0178164 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0142841 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(34560,1:4,1920,60) -> Float(138240,1,7680,240) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0120933 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0141319 [02/13/2023-19:50:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0120392 [02/13/2023-19:50:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0120392 [02/13/2023-19:50:28] [V] [TRT] *************** Autotuning Reformat: Float(34560,1:4,1920,60) -> Float(4608,576:32,32,1) *************** [02/13/2023-19:50:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0475234 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134629 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0476922 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0134629 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(34560,1:4,1920,60) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0814949 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0428834 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0824251 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0428834 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4608,576:32,32,1) -> Float(138240,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0178577 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0140264 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0179126 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0140264 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4608,576:32,32,1) -> Float(138240,1,7680,240) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0129863 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013829 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0125608 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0125608 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4608,576:32,32,1) -> Float(34560,1:4,1920,60) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0141066 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0138506 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139134 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0138506 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4608,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0821577 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0443486 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0815406 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0443486 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0118136 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.338656 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0118428 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0118136 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1,7680,240) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0202954 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.360535 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0203177 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0202954 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(34560,1:4,1920,60) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0203086 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.36027 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0202846 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0202846 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(4608,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(880 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0410171 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.360361 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.040696 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.040696 [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(138240,576,32,1) -> Float(138240,1,7680,240) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(138240,576,32,1) -> Float(34560,1:4,1920,60) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(138240,1,7680,240) -> Float(138240,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(138240,1,7680,240) -> Float(34560,1:4,1920,60) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(34560,1:4,1920,60) -> Float(138240,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(34560,1:4,1920,60) -> Float(138240,1,7680,240) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4608,576:32,32,1) -> Float(138240,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4608,576:32,32,1) -> Float(138240,1,7680,240) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4608,576:32,32,1) -> Float(34560,1:4,1920,60) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1,7680,240) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(34560,1:4,1920,60) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 883) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00766893 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0162235 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00771224 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00766893 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 883) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00805486 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0141344 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00829816 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00805486 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 883) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00911571 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136145 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00894057 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00894057 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 883) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00712316 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126945 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00712512 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00712316 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 883) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00924857 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124636 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.009268 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00924857 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 883) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00717989 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119097 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00706917 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00706917 [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(883 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00762659 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115566 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00780319 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00762659 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(883 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00789943 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112844 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00810692 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00789943 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(883 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00913486 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114641 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00913429 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00913429 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(883 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00695663 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117767 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705872 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00695663 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(883 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00936829 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113125 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00918486 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00918486 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(883 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703086 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116969 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00709311 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00703086 [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,576,32,1) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157019 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133764 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0156617 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0133764 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,576,32,1) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0158745 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131088 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157408 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0131088 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,576,32,1) -> Float(4032,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0390731 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134159 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.03908 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0134159 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0272488 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0335835 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0272053 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0272053 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,1,6400,200) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.015419 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128777 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.015504 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0128777 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,1,6400,200) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0113544 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129387 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0114033 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0113544 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,1,6400,200) -> Float(4032,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0455223 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130618 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0454674 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0130618 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,1,6400,200) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0696838 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0436286 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0700419 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0436286 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(28800,1:4,1600,50) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0156855 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129596 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0156567 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0129596 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(28800,1:4,1600,50) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0113895 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132243 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0114173 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0113895 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(28800,1:4,1600,50) -> Float(4032,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0446274 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012912 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0447691 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.012912 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(28800,1:4,1600,50) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0694903 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0429211 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0695451 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0429211 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157198 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129368 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157253 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0129368 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0113554 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131262 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0113966 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0113554 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0129276 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130327 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0126099 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0126099 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0689478 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0433166 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0686461 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0433166 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0108653 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.284379 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.011284 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0108653 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0180526 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.359913 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0179246 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0179246 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.017864 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.359625 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0178863 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.017864 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(4032,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(886 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0392263 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.359936 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0393429 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0392263 [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,576,32,1) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,576,32,1) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,1,6400,200) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,1,6400,200) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(28800,1:4,1600,50) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(28800,1:4,1600,50) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,576,32,1) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,576,32,1) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,576,32,1) -> Float(4032,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,1,6400,200) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,1,6400,200) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,1,6400,200) -> Float(4032,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,1,6400,200) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(28800,1:4,1600,50) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(28800,1:4,1600,50) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(28800,1:4,1600,50) -> Float(4032,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(28800,1:4,1600,50) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(4032,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,576,32,1) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,576,32,1) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,1,6400,200) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(115200,1,6400,200) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(28800,1:4,1600,50) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(28800,1:4,1600,50) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(4032,576:32,32,1) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(115200,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(115200,1,6400,200) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0143119 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128716 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0140655 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0128716 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0153554 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012259 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0153125 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.012259 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0303771 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119981 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0304229 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0119981 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0253882 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0312174 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.025107 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.025107 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.01407 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119246 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0140397 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0119246 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0110214 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124655 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0111789 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0110214 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0364983 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011928 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0364354 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.011928 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0651688 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0351762 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0647954 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0351762 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0143552 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118038 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014763 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0118038 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0110224 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118724 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0110615 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0110224 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0350821 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116142 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0351525 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0116142 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0642971 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0337317 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0646232 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0337317 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0141627 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120762 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014095 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0120762 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0110597 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116951 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0110449 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0110449 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116487 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115981 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116114 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0115981 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0641432 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0341714 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0640975 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0341714 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0101443 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.262487 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00993524 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00993524 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.016927 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.271936 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0164724 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0164724 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0161712 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.271771 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0160919 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0160919 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(895 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0307054 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.272219 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0308032 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0307054 [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(105984,1,5888,184) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(26496,1:4,1472,46) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(3456,576:32,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(105984,1,5888,184) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,576,32,1) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(46080,1,2560,80) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(11520,1:4,640,20) -> Float(46080,1,2560,80) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0308434 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0183263 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0315657 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0183263 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0337765 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0188949 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.031563 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0188949 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0586453 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0187126 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0589135 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0187126 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0797851 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0752046 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0808891 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0752046 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0292361 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0194097 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0296055 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0194097 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0207158 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173237 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0210612 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173237 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0725646 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172196 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0722743 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0172196 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.169029 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0822834 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.169381 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0822834 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0296466 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0192217 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0307054 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0192217 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0206132 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173343 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207458 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173343 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0729531 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173008 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0728503 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173008 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.166761 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0830789 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.169755 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0830789 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.029515 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0185657 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0293285 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0185657 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0206629 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017251 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0203503 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017251 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0245684 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017277 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0245752 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017277 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.16704 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0829806 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.167941 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0829806 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0305701 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.676873 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0313719 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0305701 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0464823 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.719648 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0466331 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0464823 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0428389 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.719186 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0409269 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0409269 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(913 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.075232 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.714597 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0754286 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.075232 [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0309202 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0189263 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0328613 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0189263 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0343817 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0187463 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0311561 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0187463 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0586834 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018244 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0589562 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.018244 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0791314 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0753509 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0804389 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0753509 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0291977 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0193109 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.030027 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0193109 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0204767 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172363 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0205564 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0172363 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0733189 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0170403 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0724251 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0170403 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.167017 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0825417 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.171287 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0825417 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0295552 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0188509 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0309184 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0188509 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0202823 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0175345 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0205832 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0175345 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0718697 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174171 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0717897 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174171 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.166322 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0829074 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.169029 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0829074 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0294098 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0185663 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0302153 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0185663 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0206694 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173069 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0201194 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173069 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241829 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174512 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0237714 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174512 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.171557 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0831086 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.168503 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0831086 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0357931 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.67061 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0356443 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0356443 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0487573 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.7144 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0496518 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0487573 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0446514 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.714299 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0526126 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0446514 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 515) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0756549 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.714505 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0753211 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0753211 [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(480,1,1,1) -> Float(480,1,480,480) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(516 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00589001 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0157998 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00626683 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00589001 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(480,1,1,1) -> Float(120,1:4,120,120) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(516 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00569494 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147502 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00576274 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00569494 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(480,1,480,480) -> Float(480,1,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(516 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00561143 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134084 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00574738 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00561143 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(480,1,480,480) -> Float(120,1:4,120,120) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(516 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00519053 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122278 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00531589 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00519053 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(120,1:4,120,120) -> Float(480,1,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(516 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00502636 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112482 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00500603 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00500603 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(120,1:4,120,120) -> Float(480,1,480,480) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(516 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0048989 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110319 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00499153 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0048989 [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(120,1,120,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(120,1,1,1) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(120,1,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(120,1,120,120) -> Float(30,1:4,30,30) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(120,1,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(30,1:4,30,30) -> Float(120,1,120,120) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(480,1,1,1) -> Float(480,1,480,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(480,1,1,1) -> Float(120,1:4,120,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(480,1,1,1) -> Float(15,1:32,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0048445 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106779 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00507239 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0048445 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(480,1,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00476846 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108193 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00494219 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00476846 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(480,1,480,480) -> Float(480,1,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(480,1,480,480) -> Float(120,1:4,120,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(480,1,480,480) -> Float(15,1:32,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0048544 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107164 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0050054 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0048544 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(480,1,480,480) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00480503 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107448 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00498301 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00480503 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(120,1:4,120,120) -> Float(480,1,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(120,1:4,120,120) -> Float(480,1,480,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(120,1:4,120,120) -> Float(15,1:32,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00484861 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109978 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0050177 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00484861 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(120,1:4,120,120) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00469265 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108121 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0049184 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00469265 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(15,1:32,1,1) -> Float(480,1,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0049693 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106844 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00510759 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0049693 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(15,1:32,1,1) -> Float(480,1,480,480) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00474293 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108963 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00494833 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00474293 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(15,1:32,1,1) -> Float(120,1:4,120,120) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00485943 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107308 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00502999 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00485943 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(15,1:32,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00482728 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010639 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0049425 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00482728 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(480,1,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00475635 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109091 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00501959 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00475635 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(480,1,480,480) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00472096 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110513 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00485455 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00472096 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(120,1:4,120,120) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00487969 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108398 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00502731 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00487969 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(15,1:32,1,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(519 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00471432 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107105 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00489524 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00471432 [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(276480,1,15360,480) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(69120,1:4,3840,120) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(8640,576:32,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(276480,1,15360,480) *************** [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(64512,576,32,1) -> Float(64512,1,3584,112) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 919) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00986667 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115235 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00981333 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00981333 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(64512,576,32,1) -> Float(16128,1:4,896,28) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 919) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00995596 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011436 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0098752 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0098752 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(64512,1,3584,112) -> Float(64512,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 919) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0109874 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011673 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0111174 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0109874 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(64512,1,3584,112) -> Float(16128,1:4,896,28) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 919) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00788114 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011769 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00786935 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00786935 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(16128,1:4,896,28) -> Float(64512,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 919) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0113182 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116881 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0112774 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0112774 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(16128,1:4,896,28) -> Float(64512,1,3584,112) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 919) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00819276 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118674 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00813587 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00813587 [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(64512,576,32,1) -> Float(64512,1,3584,112) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(919 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00972343 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115538 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00976091 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00972343 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(64512,576,32,1) -> Float(16128,1:4,896,28) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(919 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0102096 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114862 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00995078 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00995078 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(64512,1,3584,112) -> Float(64512,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(919 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0109992 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115478 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.010896 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.010896 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(64512,1,3584,112) -> Float(16128,1:4,896,28) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(919 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00778683 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119928 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00808432 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00778683 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(16128,1:4,896,28) -> Float(64512,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(919 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0112376 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112658 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0112524 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0112376 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(16128,1:4,896,28) -> Float(64512,1,3584,112) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(919 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00794971 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117915 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00793854 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00793854 [02/13/2023-19:50:29] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0427726 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.022658 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.042664 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.022658 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0419886 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0227781 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0416126 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0227781 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0807566 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.022784 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0808937 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.022784 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.118336 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.102251 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.118011 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.102251 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0389886 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0231817 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0387817 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0231817 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0271307 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020476 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0269836 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.020476 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0984091 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0203114 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0982537 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0203114 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.248142 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.112123 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.241143 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.112123 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0391314 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0230296 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.038952 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0230296 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0266088 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0203663 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0269013 [02/13/2023-19:50:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0203663 [02/13/2023-19:50:29] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0980754 [02/13/2023-19:50:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0201429 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0978217 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0201429 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.244859 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.111637 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.242089 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.111637 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0390469 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0228676 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0399509 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0228676 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0268183 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0201846 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0268701 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0201846 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0315758 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0200503 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.031648 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0200503 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.251918 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.111362 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.245755 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.111362 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0472629 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.935163 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0469063 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0469063 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0745554 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.979534 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0644831 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0644831 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0684023 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.979497 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0686507 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0684023 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(922 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.102704 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.979456 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.102839 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.102704 [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0437463 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0224738 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0435223 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0224738 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0406834 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0226162 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.040608 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0226162 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0807109 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0226233 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0805211 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0226233 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.11827 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.102039 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.120391 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.102039 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0388811 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.022959 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0388617 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.022959 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0267779 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0199737 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0269531 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0199737 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0980709 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0214779 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0983109 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0214779 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.245911 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.114937 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.250834 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.114937 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0393337 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.022942 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.038968 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.022942 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0265219 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0199663 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0266324 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0199663 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0982514 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0200326 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.098272 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0200326 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.242907 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.113017 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.251378 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.113017 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0387486 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0229107 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0399897 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0229107 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.026496 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0199343 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0266072 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0199343 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0318875 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020092 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0318656 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.020092 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.250715 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.111323 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.248544 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.111323 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0466983 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.941138 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0468583 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0466983 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0670994 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.980005 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0775177 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0670994 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.069501 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.98 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0708373 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.069501 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 531) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.103031 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.979607 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.10272 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.10272 [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,1,1) -> Float(672,1,672,672) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(532 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00617276 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173765 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00716229 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00617276 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,1,1) -> Float(168,1:4,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(532 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00582217 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0156791 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0059275 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00582217 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,672,672) -> Float(672,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(532 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00559121 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.014683 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00597352 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00559121 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,672,672) -> Float(168,1:4,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(532 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00533079 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133602 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00566171 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00533079 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1:4,168,168) -> Float(672,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(532 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00517649 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0125154 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00534011 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00517649 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1:4,168,168) -> Float(672,1,672,672) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(532 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00492648 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112566 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00499137 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00492648 [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1,1,1) -> Float(168,1,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(534 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00476122 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108545 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00500382 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00476122 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1,1,1) -> Float(42,1:4,42,42) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(534 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00475915 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111065 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0049611 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00475915 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1,168,168) -> Float(168,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(534 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00487863 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108986 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00509872 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00487863 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1,168,168) -> Float(42,1:4,42,42) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(534 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00499058 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111005 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00500634 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00499058 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(42,1:4,42,42) -> Float(168,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(534 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00478232 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110646 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00499641 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00478232 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(42,1:4,42,42) -> Float(168,1,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(534 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00477211 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111849 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00503898 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00477211 [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,1,1) -> Float(672,1,672,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,1,1) -> Float(168,1:4,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,1,1) -> Float(21,1:32,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00483718 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108578 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00511282 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00483718 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00482027 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110797 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.005024 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00482027 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,672,672) -> Float(672,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,672,672) -> Float(168,1:4,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,672,672) -> Float(21,1:32,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00478309 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108082 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00498963 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00478309 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,672,672) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00475665 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109574 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00508138 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00475665 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1:4,168,168) -> Float(672,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1:4,168,168) -> Float(672,1,672,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1:4,168,168) -> Float(21,1:32,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00486888 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112102 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00497151 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00486888 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1:4,168,168) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00477364 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111262 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00488 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00477364 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(21,1:32,1,1) -> Float(672,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00474205 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010914 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00507082 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00474205 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(21,1:32,1,1) -> Float(672,1,672,672) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00476785 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011008 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00499232 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00476785 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(21,1:32,1,1) -> Float(168,1:4,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00484998 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107396 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00504969 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00484998 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(21,1:32,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00476526 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108836 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00494487 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00476526 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(672,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00486674 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110636 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00507429 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00486674 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(672,1,672,672) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0047798 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109316 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0049466 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0047798 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(168,1:4,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00485333 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109901 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0050776 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00485333 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(21,1:32,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00470194 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111515 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00495433 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00470194 [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(64512,576,32,1) -> Float(64512,1,3584,112) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(64512,576,32,1) -> Float(16128,1:4,896,28) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(64512,1,3584,112) -> Float(64512,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(64512,1,3584,112) -> Float(16128,1:4,896,28) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(16128,1:4,896,28) -> Float(64512,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(16128,1:4,896,28) -> Float(64512,1,3584,112) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(64512,576,32,1) -> Float(64512,1,3584,112) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(64512,576,32,1) -> Float(16128,1:4,896,28) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(64512,1,3584,112) -> Float(64512,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(64512,1,3584,112) -> Float(16128,1:4,896,28) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(16128,1:4,896,28) -> Float(64512,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(16128,1:4,896,28) -> Float(64512,1,3584,112) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,1,1) -> Float(672,1,672,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,1,1) -> Float(168,1:4,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,672,672) -> Float(672,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,672,672) -> Float(168,1:4,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1:4,168,168) -> Float(672,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1:4,168,168) -> Float(672,1,672,672) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1,1,1) -> Float(168,1,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1,1,1) -> Float(42,1:4,42,42) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1,168,168) -> Float(168,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1,168,168) -> Float(42,1:4,42,42) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(42,1:4,42,42) -> Float(168,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(42,1:4,42,42) -> Float(168,1,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,1,1) -> Float(672,1,672,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,1,1) -> Float(168,1:4,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,1,1) -> Float(21,1:32,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,672,672) -> Float(672,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,672,672) -> Float(168,1:4,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,672,672) -> Float(21,1:32,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(672,1,672,672) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1:4,168,168) -> Float(672,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1:4,168,168) -> Float(672,1,672,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1:4,168,168) -> Float(21,1:32,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(168,1:4,168,168) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(21,1:32,1,1) -> Float(672,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(21,1:32,1,1) -> Float(672,1,672,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(21,1:32,1,1) -> Float(168,1:4,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(21,1:32,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(672,1,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(672,1,672,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(168,1:4,168,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(21,1:32,1,1) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(387072,1,21504,672) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(96768,1:4,5376,168) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(12096,576:32,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(387072,1,21504,672) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 937) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0137151 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113927 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136395 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0113927 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 937) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0137916 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113779 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136785 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0113779 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 937) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0137737 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115464 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137621 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0115464 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 937) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00963779 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011271 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00969356 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00963779 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 937) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0137849 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115738 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137704 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0115738 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 937) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00964206 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114022 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00970667 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00964206 [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(937 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0136586 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114317 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013728 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0114317 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(937 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138257 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113055 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138373 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0113055 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(937 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0136536 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116403 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013679 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0116403 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(937 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00959969 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112999 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00971794 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00959969 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(937 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0136914 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117767 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136507 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0117767 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(937 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0095808 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112802 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00969691 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0095808 [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0579246 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0307264 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0579078 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0307264 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0576061 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0281745 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0580632 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0281745 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.117504 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0302482 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.117262 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0302482 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.176987 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.142779 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.179639 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.142779 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0553295 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0313792 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.055261 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0313792 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.039984 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0270095 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0405737 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0270095 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.145806 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0311351 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.145413 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0311351 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.371433 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.149751 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.371058 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.149751 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0553752 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0337344 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.05552 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0337344 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0411109 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0260686 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0412526 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0260686 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.145742 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0309742 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.144297 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0309742 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.373792 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.148891 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.369915 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.148891 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0554651 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0314496 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0550888 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0314496 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0409726 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0266865 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0414971 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0266865 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0445623 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0300699 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0445634 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0300699 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.370784 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.148183 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.371415 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.148183 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0637882 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.33306 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.064064 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0637882 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.105659 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.33345 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.10899 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.105659 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.103419 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.33296 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.106974 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.103419 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(940 -> ) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.143643 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.33251 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.143543 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.143543 [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0580602 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0297902 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.057981 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0297902 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0591573 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0282362 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0593783 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0282362 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.119175 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0298523 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.119161 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0298523 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.18053 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.143209 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.177856 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.143209 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0569813 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0317422 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0570011 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0317422 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0403646 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0284876 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0386297 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0284876 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.145856 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0275482 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.146354 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0275482 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.367013 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.149778 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.370382 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.149778 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0548404 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0315346 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0543543 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0315346 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0391303 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0241021 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.040368 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0241021 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.144297 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0264488 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.143035 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0264488 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.363301 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.150071 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.364343 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.150071 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0547779 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0310793 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0539383 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0310793 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0401966 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0260617 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0399771 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0260617 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0449657 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.027549 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0446971 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.027549 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.370889 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.152663 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.367442 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.152663 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0642286 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.34384 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0638369 [02/13/2023-19:50:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0638369 [02/13/2023-19:50:30] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.125406 [02/13/2023-19:50:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.34191 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.103851 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.103851 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.107195 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.33296 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.102702 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.102702 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 564) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.143232 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.33304 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.143634 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.143232 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(565 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00580718 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0156119 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00627101 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00580718 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(565 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00555516 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0143433 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.006008 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00555516 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(565 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00551842 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0140621 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00566558 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00551842 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(565 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00522661 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123592 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00532521 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00522661 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(565 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00508106 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115924 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00515804 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00508106 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(565 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00475576 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110882 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00496268 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00475576 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1,1,1) -> Float(240,1,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00483429 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108856 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00492658 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00483429 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1,1,1) -> Float(60,1:4,60,60) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00484312 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110576 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00502242 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00484312 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1,240,240) -> Float(240,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00487726 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111518 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00506735 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00487726 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1,240,240) -> Float(60,1:4,60,60) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00485501 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111979 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00491352 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00485501 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(60,1:4,60,60) -> Float(240,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00489082 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111909 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00502006 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00489082 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(60,1:4,60,60) -> Float(240,1,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00475915 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112394 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00493699 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00475915 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(30,1:32,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00490316 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110038 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00512245 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00490316 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00480823 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110347 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00504985 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00480823 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(30,1:32,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00478888 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109946 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00493951 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00478888 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00473777 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112011 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00501911 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00473777 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(30,1:32,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00490484 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108091 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00504922 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00490484 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00468778 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111434 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00499862 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00468778 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(30,1:32,1,1) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00478461 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109332 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00498995 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00478461 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(30,1:32,1,1) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00472376 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010799 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00507019 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00472376 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(30,1:32,1,1) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00487634 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010782 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00501722 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00487634 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(30,1:32,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00462747 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110221 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00487299 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00462747 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00487162 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106952 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00517045 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00487162 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00474264 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106184 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00496441 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00474264 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00471683 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109058 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00489448 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00471683 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(30,1:32,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(568 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00468173 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108245 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00493431 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00468173 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1,1,1) -> Float(240,1,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1,1,1) -> Float(60,1:4,60,60) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1,240,240) -> Float(240,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1,240,240) -> Float(60,1:4,60,60) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(60,1:4,60,60) -> Float(240,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(60,1:4,60,60) -> Float(240,1,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(30,1:32,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(30,1:32,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(30,1:32,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(30,1:32,1,1) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(30,1:32,1,1) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(30,1:32,1,1) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(30,1:32,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(30,1:32,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,576,32,1) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,5120,160) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,1280,40) -> Float(92160,1,5120,160) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,1,30720,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(552960,1,30720,960) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(138240,1:4,7680,240) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(17280,576:32,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,1,1) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(960,1,960,960) -> Float(240,1:4,240,240) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(960,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(240,1:4,240,240) -> Float(960,1,960,960) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(128,1,1,1) -> Float(128,1,128,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00449486 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109633 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00473143 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00449486 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(128,1,1,1) -> Float(32,1:4,32,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00459243 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109257 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0047645 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00459243 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(128,1,1,1) -> Float(4,1:32,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00461375 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111465 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00490103 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00461375 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(128,1,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00490804 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108963 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00496363 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00490804 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(128,1,128,128) -> Float(128,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00468468 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108855 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00491459 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00468468 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(128,1,128,128) -> Float(32,1:4,32,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00458914 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112306 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00481935 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00458914 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(128,1,128,128) -> Float(4,1:32,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00459857 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110491 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0047245 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00459857 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(128,1,128,128) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00474986 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110302 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00502069 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00474986 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(32,1:4,32,32) -> Float(128,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00455657 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112141 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00476602 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00455657 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(32,1:4,32,32) -> Float(128,1,128,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00464929 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109339 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00474971 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00464929 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(32,1:4,32,32) -> Float(4,1:32,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00459 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108003 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00481996 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00459 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(32,1:4,32,32) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00476282 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112081 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00503645 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00476282 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(4,1:32,1,1) -> Float(128,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00461331 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109744 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00477242 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00461331 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(4,1:32,1,1) -> Float(128,1,128,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00452829 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107912 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0047416 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00452829 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(4,1:32,1,1) -> Float(32,1:4,32,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00473703 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011033 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00492251 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00473703 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(4,1:32,1,1) -> Float(1:4,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00478674 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110347 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00500051 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00478674 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(128,1,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00474853 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010639 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00486888 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00474853 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(128,1,128,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00465357 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011104 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00463454 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00463454 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(32,1:4,32,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00470813 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107161 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0047936 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00470813 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1,1,1) -> Float(4,1:32,1,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(599 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00472789 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010543 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00479665 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00472789 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116076 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109022 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0115376 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0109022 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116213 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108663 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116301 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0108663 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0201057 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108993 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.02012 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0108993 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0190103 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0228989 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0189594 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0189594 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0114729 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110193 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0115861 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0110193 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00894143 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107595 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00887664 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00887664 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0239901 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107536 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023759 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107536 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.046496 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.024845 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0466869 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.024845 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0115443 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01106 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116656 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.01106 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00899029 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108545 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00896714 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00896714 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230393 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111532 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229767 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0111532 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.04664 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.024941 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0464594 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.024941 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0118432 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110305 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116301 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0110305 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00896628 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108039 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00890461 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00890461 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0095872 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106005 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00949571 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00949571 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.046992 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0248472 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0464331 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0248472 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00872121 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.183259 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00885351 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00872121 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0118421 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.182464 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0117697 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0117697 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0119459 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.183607 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0117753 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0117753 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(597 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.020192 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.182656 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0203109 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.020192 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.011559 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107585 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0115945 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107585 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116079 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110745 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116396 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0110745 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0200417 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106792 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0199777 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0106792 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0190811 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0229871 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0189371 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0189371 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0115196 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110207 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0115407 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0110207 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00894657 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106325 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00886803 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00886803 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.023901 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105678 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0238735 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0105678 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0465714 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0248617 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0467554 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0248617 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.011642 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109211 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116111 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0109211 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00894257 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106152 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.008976 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00894257 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0227213 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106002 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023042 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0106002 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0462046 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0248594 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.046728 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0248594 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0117482 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111385 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116631 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0111385 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00898686 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107918 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00895343 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00895343 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00963962 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106139 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00952057 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00952057 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0464834 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0249493 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0468331 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0249493 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00880511 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.183822 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00881587 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00880511 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0118259 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.183717 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.011718 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.011718 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.011827 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.183895 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0118643 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.011827 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 601) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0201971 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.183451 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0202309 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0201971 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 608) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00694596 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109342 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00702019 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00694596 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 608) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00716754 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106442 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00707461 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00707461 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 608) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.011941 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106452 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.01182 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0106452 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 608) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116076 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0139225 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.011604 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.011604 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00476373 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107905 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00571739 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00476373 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00700299 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106909 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00699668 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00699668 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00719268 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107076 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00701714 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00701714 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0117978 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107455 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0117507 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107455 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00699821 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145536 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00701083 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00699821 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00878844 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105985 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00878387 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00878387 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00660301 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108833 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00623781 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00623781 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00678919 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108382 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00676779 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00676779 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138805 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010736 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013792 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.010736 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00959421 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158994 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00954697 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00954697 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00883792 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106694 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00880887 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00880887 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00675574 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107768 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00698318 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00675574 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00694487 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109107 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00698297 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00694487 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138452 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107553 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138701 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107553 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00954545 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158665 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00952533 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00952533 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00884894 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105864 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00890299 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00884894 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00678836 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109313 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00686672 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00678836 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00691809 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107158 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00700539 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00691809 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.013851 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106635 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00575159 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00575159 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0095747 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0161717 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00960671 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0095747 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00669881 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0956983 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00660094 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00660094 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703521 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0944046 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.007144 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00703521 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00712359 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0948 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00711532 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00711532 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125269 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0949371 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0128168 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0125269 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 606 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00735086 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0900617 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00722811 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00722811 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(612 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00700125 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110495 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00707853 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00700125 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(612 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0119737 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107291 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.011744 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107291 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(612 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00875428 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106194 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00886938 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00875428 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(612 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00674805 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107784 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00681317 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00674805 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(612 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.013915 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107598 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138984 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107598 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(612 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00891751 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107262 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00884787 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00884787 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(612 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0137529 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111627 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139055 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0111627 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(612 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00895029 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107125 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00887879 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00887879 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(612 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00699712 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109564 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00707766 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00699712 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(612 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00675844 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0951406 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00671688 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00671688 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(612 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00720823 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0954674 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00713535 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00713535 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(612 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0127196 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0954126 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124141 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0124141 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 614) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0087239 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108637 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00880968 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0087239 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 614) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00678067 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107977 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00682209 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00678067 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 614) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138971 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106844 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138485 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0106844 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 614) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00885593 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108633 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00890057 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00885593 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 614) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0068578 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106994 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00679771 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00679771 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 614) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00699146 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108137 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0069612 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0069612 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(36864,576,32,1) -> Float(36864,1,2048,64) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00693529 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106184 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00699929 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00693529 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(36864,576,32,1) -> Float(9216,1:4,512,16) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00704653 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108989 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705154 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00704653 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(36864,576,32,1) -> Float(1152,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0120263 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104816 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0118375 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0104816 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(36864,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0115267 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0139848 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116448 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0115267 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(36864,1,2048,64) -> Float(36864,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00880108 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105734 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00878871 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00878871 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(36864,1,2048,64) -> Float(9216,1:4,512,16) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00684822 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107595 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00676571 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00676571 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(36864,1,2048,64) -> Float(1152,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.013937 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107184 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139121 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107184 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(36864,1,2048,64) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0265257 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0159695 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.026496 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0159695 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(9216,1:4,512,16) -> Float(36864,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00878951 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010689 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00875805 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00875805 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(9216,1:4,512,16) -> Float(36864,1,2048,64) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00683015 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106818 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00693268 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00683015 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(9216,1:4,512,16) -> Float(1152,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138535 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108526 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138664 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0108526 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(9216,1:4,512,16) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0265295 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158976 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0263756 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0158976 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1152,576:32,32,1) -> Float(36864,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00890783 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106482 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00890703 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00890703 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1152,576:32,32,1) -> Float(36864,1,2048,64) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00676093 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104617 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00688174 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00676093 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1152,576:32,32,1) -> Float(9216,1:4,512,16) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00709921 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105499 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00704784 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00704784 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1152,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0265493 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0160945 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0265242 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0160945 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(36864,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00679605 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0951429 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00657039 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00657039 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(36864,1,2048,64) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0071003 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0950491 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705546 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00705546 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(9216,1:4,512,16) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00722423 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0954789 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00716865 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00716865 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(1152,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(616 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0120339 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0953966 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0121059 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0120339 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(613 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00698819 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106828 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00699342 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00698819 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(613 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116913 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0137479 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116125 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0116125 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(613 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0265112 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0155945 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0264762 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0155945 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(613 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00677964 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107589 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00685388 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00677964 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(613 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0265859 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0156923 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0264945 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0156923 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(613 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00681752 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105522 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00684495 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00681752 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(613 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0265204 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0157394 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0265394 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0157394 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(613 -> ) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00710857 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0953874 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00708941 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00708941 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,1,4096,128) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(36864,1,2048,64) -> Float(36864,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> r4o) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00874514 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010462 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00860235 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00860235 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(9216,1:4,512,16) -> Float(36864,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> r4o) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00888955 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107239 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00881103 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00881103 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1152,576:32,32,1) -> Float(36864,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> r4o) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00895429 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107242 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00891455 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00891455 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(36864,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> r4o) (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00674826 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0949257 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00669299 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00669299 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(73728,1,4096,128) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(18432,1:4,1024,32) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(2304,576:32,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(36864,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: r4o copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00541867 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104767 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00562338 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00541867 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(294912,2304,64,1) -> Float(393984,2304,64,1) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 628 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00886696 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0208973 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00885701 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00885701 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(294912,2304,64,1) -> Float(393984,1,10944,171) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 628 copy (Reformat) [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0339913 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0219455 [02/13/2023-19:50:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0341815 [02/13/2023-19:50:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0219455 [02/13/2023-19:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:31] [V] [TRT] *************** Autotuning Reformat: Float(294912,2304,64,1) -> Float(99072,1:4,2752,43) *************** [02/13/2023-19:50:31] [V] [TRT] --------------- Timing Runner: 628 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0339511 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01725 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0356352 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.01725 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(393984,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 464 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00532741 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106713 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00570831 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00532741 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(393984,1,10944,171) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 464 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00969021 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013531 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00978225 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00969021 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(99072,1:4,2752,43) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 464 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0106273 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136179 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0107654 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0106273 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(393984,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 464 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.013654 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0135672 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013792 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0135672 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(393984,1,10944,171) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 464 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.009158 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150144 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00906971 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00906971 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(99072,1:4,2752,43) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 464 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00971703 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132858 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00969905 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00969905 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(393984,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 464 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0136266 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136328 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0135136 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0135136 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(393984,1,10944,171) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 464 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00961067 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149646 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00987825 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00961067 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(99072,1:4,2752,43) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 464 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0113206 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013258 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0113456 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0113206 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(393984,2304,64,1) -> Float(393984,1,10944,171) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(637 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0412594 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0275848 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0413977 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0275848 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(393984,2304,64,1) -> Float(99072,1:4,2752,43) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(637 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0464629 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0252015 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0488122 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0252015 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(393984,1,10944,171) -> Float(393984,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(637 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0384526 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0248747 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.038576 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0248747 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(393984,1,10944,171) -> Float(99072,1:4,2752,43) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(637 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0301888 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0230877 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0300992 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0230877 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(99072,1:4,2752,43) -> Float(393984,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(637 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0377749 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0236793 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0380126 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0236793 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(99072,1:4,2752,43) -> Float(393984,1,10944,171) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(637 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0278423 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0322432 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.028096 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0278423 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 640) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0181434 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0180046 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0178823 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0178823 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 640) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0181451 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179571 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0179737 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0179571 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 640) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0206883 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182463 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207922 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182463 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 640) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157531 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174557 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0156965 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0156965 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 640) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0208118 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182497 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.020702 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182497 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 640) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0155209 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173943 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157019 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0155209 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 644) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00964175 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136245 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00967558 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00964175 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 644) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.010209 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134886 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00983619 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00983619 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 644) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0528503 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0137072 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0530438 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0137072 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 644) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0226958 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.027805 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0225195 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0225195 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00539903 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110372 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00561477 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00539903 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00967558 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0135215 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0097347 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00967558 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0105998 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136544 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0108294 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0105998 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230622 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132817 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0226873 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0132817 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.011353 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.029579 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.011417 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.011353 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0136598 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133619 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0135568 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0133619 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00903543 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131753 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00902457 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00902457 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00960549 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013137 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00968168 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00960549 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0285906 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133664 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0284968 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0133664 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.016193 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0450469 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0159426 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0159426 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0136873 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133515 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136266 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0133515 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00957897 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131794 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00971063 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00957897 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0112668 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131117 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0112672 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0112668 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0283832 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132447 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0284739 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0132447 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 642 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0160015 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0455337 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0158359 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0158359 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(645 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0179743 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179234 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0178535 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0178535 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(645 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0180269 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0180623 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0179486 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0179486 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(645 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0206602 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182989 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0206981 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182989 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(645 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157097 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172566 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0156361 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0156361 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(645 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0206929 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182663 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207262 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182663 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(645 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0155145 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173338 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0155758 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0155145 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(645 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0208176 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0184583 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207451 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0184583 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(645 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0155374 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174684 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157435 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0155374 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(645 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0179234 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174735 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0179554 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174735 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(645 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0170987 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.450098 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0170519 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0170519 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(645 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0546865 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.71355 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0560305 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0546865 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(645 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0557577 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.712992 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0555962 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0555962 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(646 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0711695 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0181263 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0709608 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0181263 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(646 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.041696 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0523093 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0416457 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0416457 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(646 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0812183 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017631 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.081408 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017631 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(646 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.107927 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0836823 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.107632 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0836823 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(646 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.080544 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0178966 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0801463 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0178966 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(646 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.106672 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0849783 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.106825 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0849783 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(646 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.10587 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0832686 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.106094 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0832686 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(646 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0738149 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.71483 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0736549 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0736549 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0711543 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186126 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0711589 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186126 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0406194 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0510857 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.040776 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0406194 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0809257 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0178311 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0806354 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0178311 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.107522 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0831131 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.10771 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0831131 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0800777 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182425 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0799086 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182425 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.106887 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0848983 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.106939 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0848983 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.02083 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0190189 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207811 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0190189 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0154885 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0180143 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0156027 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0154885 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0176102 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0178118 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0177417 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0176102 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.105438 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0833623 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.105842 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0833623 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0154295 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.448864 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0160381 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0154295 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0544168 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.712398 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0545859 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0544168 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0554453 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.712709 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0553844 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0553844 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 647) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0741737 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.711927 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0741966 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0741737 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(648 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100154 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0201783 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.010206 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0100154 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(648 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.067715 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01842 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0680198 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.01842 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(648 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.013681 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0183994 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0130789 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0130789 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(648 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0095875 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0188606 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00967832 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0095875 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(648 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.072672 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0160899 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.072864 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0160899 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(648 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0132746 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173745 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0132526 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0132526 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(648 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0722903 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0161976 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.072368 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0161976 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(648 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0133922 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0168361 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0133286 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0133286 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(648 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0111539 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0168747 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0111578 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0111539 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(648 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00953966 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.227854 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00940314 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00940314 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(648 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0245547 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.359977 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0244472 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0244472 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(648 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0670415 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.35979 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.066912 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.066912 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(644 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0722994 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0162783 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0722857 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0162783 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 650) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134225 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01677 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0133116 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0133116 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 650) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00951286 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0151762 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00942886 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00942886 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 650) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0578286 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148745 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0577768 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0148745 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 650) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0135539 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0151909 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0135676 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0135539 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 650) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00959025 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0141727 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00960549 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00959025 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 650) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0111153 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145211 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0111233 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0111153 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 650) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0575634 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136761 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0576213 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0136761 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(4608,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0673478 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0141723 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0679436 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0141723 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0225365 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0275215 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0224549 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0224549 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(4608,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0727748 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0135418 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0726171 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0135418 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0569859 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0458869 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0570743 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0458869 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(4608,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0725257 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145344 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0723634 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0145344 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0567421 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0455051 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0569326 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0455051 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(4608,2304:32,64,1) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.013605 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0142737 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0134828 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0134828 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(4608,2304:32,64,1) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00963505 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0143694 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00963749 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00963505 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(4608,2304:32,64,1) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0110882 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0139142 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0110706 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0110706 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(4608,2304:32,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.056579 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.04504 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0567436 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.04504 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00945743 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.227927 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00951829 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00945743 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(92160,1,2560,40) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0245912 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.360101 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0246857 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0245912 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0246568 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.361353 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0245684 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0245684 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(4608,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(652 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0671543 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.360558 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0670415 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0670415 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(649 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0099197 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150313 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00971276 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00971276 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(649 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0225071 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0280648 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228003 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0225071 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(649 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0570103 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0456457 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0575802 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0456457 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(649 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00962651 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145993 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00957166 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00957166 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(649 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0569676 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.04512 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0570804 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.04512 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(649 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0096893 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0143131 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00956648 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00956648 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(649 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0567253 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0452651 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0561996 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0452651 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(649 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024483 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.359675 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0245249 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.024483 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(6912,2304:32,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(184320,1,5120,80) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,1,2560,40) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(23040,1:4,640,10) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(4608,2304:32,64,1) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> r3o) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134853 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148709 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0135302 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0134853 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,2304,64,1) -> Float(92160,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> r3o) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00944314 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.228 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00936457 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00936457 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,5120,80) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,1280,20) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(92160,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: r3o copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00698079 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013083 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00668052 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00668052 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(737280,9216,128,1) -> Float(986112,9216,128,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 664 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0366457 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0507032 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0387669 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0366457 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(737280,9216,128,1) -> Float(986112,1,13696,107) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 664 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.117097 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0586667 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.116402 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0586667 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(737280,9216,128,1) -> Float(248832,1:4,3456,27) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 664 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.116638 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0534522 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.116535 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0534522 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(221184,9216,128,1) -> Float(986112,9216,128,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 420 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00719429 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171688 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00771465 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00719429 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(221184,9216,128,1) -> Float(986112,1,13696,107) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 420 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220088 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0297673 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0223242 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0220088 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(221184,9216,128,1) -> Float(248832,1:4,3456,27) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 420 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0223634 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.029461 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228558 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0223634 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(221184,1,3072,24) -> Float(986112,9216,128,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 420 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0201149 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0292571 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0201783 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0201149 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(221184,1,3072,24) -> Float(986112,1,13696,107) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 420 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.016381 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0291593 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0154656 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0154656 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(221184,1,3072,24) -> Float(248832,1:4,3456,27) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 420 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.017795 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0292718 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0176615 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0176615 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(55296,1:4,768,6) -> Float(986112,9216,128,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 420 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0202269 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0289253 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0202594 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0202269 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(55296,1:4,768,6) -> Float(986112,1,13696,107) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 420 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0174959 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0301294 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0174029 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0174029 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(55296,1:4,768,6) -> Float(248832,1:4,3456,27) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: 420 copy (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.021009 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0289582 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0211435 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.021009 [02/13/2023-19:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:32] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(986112,9216,128,1) -> Float(986112,1,13696,107) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(673 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.169015 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0617646 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.169838 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0617646 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(986112,9216,128,1) -> Float(248832,1:4,3456,27) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(673 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.183845 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0554651 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.185038 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0554651 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(986112,1,13696,107) -> Float(986112,9216,128,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(673 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0997028 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0607238 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.100217 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0607238 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(986112,1,13696,107) -> Float(248832,1:4,3456,27) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(673 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0753989 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0554362 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.076192 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0554362 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(248832,1:4,3456,27) -> Float(986112,9216,128,1) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(673 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.103536 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0619048 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.103586 [02/13/2023-19:50:32] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0619048 [02/13/2023-19:50:32] [V] [TRT] *************** Autotuning Reformat: Float(248832,1:4,3456,27) -> Float(986112,1,13696,107) *************** [02/13/2023-19:50:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(673 -> ) (Reformat) [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0692754 [02/13/2023-19:50:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0810057 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0690682 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0690682 [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 676) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0466297 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0300325 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0466914 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0300325 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 676) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0472594 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.029909 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.047152 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.029909 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 676) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0395977 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0299035 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0396983 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0299035 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 676) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0259695 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0294583 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0258712 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0258712 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 676) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0394697 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0300416 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0395554 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0300416 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 676) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0257486 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0294382 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0257242 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0257242 [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 680) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157033 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0296229 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0154153 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0154153 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 680) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0163789 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0292361 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0165206 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0163789 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 680) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.212946 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0296704 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.212928 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0296704 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 680) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0428914 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.052253 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0474491 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0428914 [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00695641 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0153829 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00717737 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00695641 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0162037 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0294967 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0159893 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0159893 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0167568 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0296 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0167426 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0167426 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0408389 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0291246 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0408731 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0291246 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0205107 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0537341 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0238008 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0205107 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0228944 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.029099 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229081 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0228944 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0140035 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0290149 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137795 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0137795 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0154135 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0291648 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0155259 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0154135 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0518796 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.028875 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.051651 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.028875 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0308032 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.161554 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.033952 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0308032 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0228278 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0289673 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228767 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0228278 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.015205 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0290551 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0152494 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.015205 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0174608 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0290039 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0174095 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0174095 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0506865 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0292233 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0509074 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0292233 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: 678 copy (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0328393 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.161984 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.032235 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.032235 [02/13/2023-19:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(681 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0465017 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0299246 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0463131 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0299246 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(681 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0476583 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0300014 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0478126 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0300014 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(681 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0397829 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0301056 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0395817 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0301056 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(681 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0265189 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0293934 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0263916 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0263916 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(681 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0397474 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0298624 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0397063 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0298624 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(681 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0262202 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0294455 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0260419 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0260419 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(681 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0396663 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0299099 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0395954 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0299099 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(681 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0271406 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0298176 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0272046 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0271406 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(681 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.030336 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0292297 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0309861 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0292297 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(681 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0452286 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.890967 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0451474 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0451474 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(681 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0829303 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.41894 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.086384 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0829303 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(681 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0847566 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.41929 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0835017 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0835017 [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(682 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.250459 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0274377 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.249774 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0274377 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(682 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.111808 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0975451 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.111067 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0975451 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(682 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.269888 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0257844 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.270071 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0257844 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(682 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.222953 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.164471 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.223296 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.164471 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(682 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.269815 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0297326 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.269047 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0297326 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(682 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.224763 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.165184 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.222807 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.165184 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(682 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.236261 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.164512 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.234866 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.164512 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(682 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.269554 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.41942 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.270085 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.269554 [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.250907 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0273973 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.249531 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0273973 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.114418 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0973623 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.114411 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0973623 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.268425 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.027587 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.270469 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.027587 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.22315 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.165326 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.223657 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.165326 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.267662 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0280015 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.268855 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0280015 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.227113 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.164795 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.228503 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.164795 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0400971 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0293806 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0404446 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0293806 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0268594 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0323602 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0270758 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0268594 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0314295 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0289298 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0314341 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0289298 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.236059 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.164407 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.235104 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.164407 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0452206 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.891698 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0452069 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0452069 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0831703 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.41962 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0830697 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0830697 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0856114 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.41972 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0862857 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0856114 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 683) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.269705 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.41976 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.269719 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.269705 [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0159035 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0294866 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0158194 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0158194 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.127239 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0287378 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.127143 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0287378 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0225672 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0296613 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0227037 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0225672 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0152955 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0284145 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0154738 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0152955 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.138014 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.028885 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.13805 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.028885 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0228415 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0289591 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0224372 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0224372 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.136869 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0287936 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.137067 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0287936 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0227474 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0290066 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0226553 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0226553 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0176142 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0283413 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0176792 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0176142 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0156315 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.448946 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0161432 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0156315 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236271 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.41621 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0235807 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0235807 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.132366 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.4172 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.130613 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.130613 [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(680 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.137474 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.030123 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.136201 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.030123 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 686) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0160635 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.029088 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157413 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0157413 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 686) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0151776 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0287726 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0151319 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0151319 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 686) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.218702 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0297262 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.218318 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0297262 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 686) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0225835 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0291419 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228735 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0225835 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 686) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0148805 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0283695 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0150267 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0148805 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 686) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0171972 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.028757 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0174908 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0171972 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 686) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.221367 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0302921 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.221765 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0302921 [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(184320,9216,128,1) -> Float(184320,1,2560,20) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0154075 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0290587 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0153344 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0153344 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(184320,9216,128,1) -> Float(46080,1:4,640,5) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0159472 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0290615 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0159497 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0159472 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(184320,9216,128,1) -> Float(9216,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.127413 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0292224 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.127191 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0292224 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(184320,9216,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0412526 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0503985 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0413154 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0412526 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,2560,20) -> Float(184320,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0162382 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0292498 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0161539 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0161539 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,2560,20) -> Float(46080,1:4,640,5) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0154725 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0285934 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157157 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0154725 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,2560,20) -> Float(9216,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.132965 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0287205 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.132562 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0287205 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,2560,20) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.104174 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.165454 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.103831 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.103831 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,640,5) -> Float(184320,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0161153 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0290597 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0161905 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0161153 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,640,5) -> Float(184320,1,2560,20) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0154478 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0284312 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.015541 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0154478 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,640,5) -> Float(9216,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.132937 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0287598 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.1328 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0287598 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,640,5) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.103591 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.165262 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.103673 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.103591 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(9216,9216:32,128,1) -> Float(184320,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0228898 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.02896 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0222766 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0222766 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(9216,9216:32,128,1) -> Float(184320,1,2560,20) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.015456 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0285128 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0149723 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0149723 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(9216,9216:32,128,1) -> Float(46080,1:4,640,5) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0177346 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0284419 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0174867 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0174867 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(9216,9216:32,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.107943 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.165294 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.107909 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.107909 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(184320,9216,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0165684 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.448882 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0158139 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0158139 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(184320,1,2560,20) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0224503 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.41625 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0225012 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0224503 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(46080,1:4,640,5) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.022225 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.41669 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0225502 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.022225 [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(9216,9216:32,128,1) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(688 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.130251 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.4175 [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.129984 [02/13/2023-19:50:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.129984 [02/13/2023-19:50:33] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:33] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(685 -> ) (Reformat) [02/13/2023-19:50:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0155314 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0290213 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0152073 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0152073 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(685 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.04072 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0501531 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0412549 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.04072 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(685 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.110766 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.166345 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.108443 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.108443 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(685 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0153714 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0284046 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0153362 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0153362 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(685 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.110043 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.166848 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.110265 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.110043 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(685 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0152544 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0292169 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0153184 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0152544 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(685 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.119447 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.166811 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.118256 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.118256 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(685 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233822 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.41659 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.022464 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.022464 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(18432,9216:32,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(368640,1,5120,40) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(184320,1,2560,20) -> Float(184320,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> r2o) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.016029 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0290779 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0160051 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0160051 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(46080,1:4,640,5) -> Float(184320,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> r2o) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0160823 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0289783 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0159162 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0159162 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(9216,9216:32,128,1) -> Float(184320,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> r2o) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0226612 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0293394 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0227226 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0226612 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,9216,128,1) -> Float(184320,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> r2o) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157938 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.450149 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0161265 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0157938 [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(368640,1,5120,40) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(92160,1:4,1280,10) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(184320,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: r2o copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.009392 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179663 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00831822 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00831822 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1474560,36864,256,1) -> Float(2174976,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 700 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0672747 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0932754 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0715215 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0672747 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1474560,36864,256,1) -> Float(2174976,1,15104,59) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 700 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.176951 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.115305 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.177189 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.115305 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1474560,36864,256,1) -> Float(552960,1:4,3840,15) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 700 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.176151 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.106258 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.176133 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.106258 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(2174976,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 403 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0258126 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0415086 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0287909 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0258126 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(2174976,1,15104,59) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 403 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0571916 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0520442 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0595535 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0520442 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(552960,1:4,3840,15) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 403 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0588419 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0470023 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0597638 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0470023 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(2174976,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 403 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0442446 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.09848 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0440469 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0440469 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(2174976,1,15104,59) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 403 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0470331 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.10131 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0471314 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0470331 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(552960,1:4,3840,15) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 403 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0472594 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101086 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0470891 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0470891 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(2174976,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 403 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0430114 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100496 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0425817 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0425817 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(2174976,1,15104,59) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 403 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0493318 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101584 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0493333 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0493318 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(552960,1:4,3840,15) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 403 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0512716 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101314 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0510613 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0510613 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(2174976,36864,256,1) -> Float(2174976,1,15104,59) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(709 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.285614 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.111682 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.289353 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.111682 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(2174976,36864,256,1) -> Float(552960,1:4,3840,15) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(709 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.326656 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.108805 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.326354 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.108805 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(2174976,1,15104,59) -> Float(2174976,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(709 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.635328 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.107698 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.723639 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.107698 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(2174976,1,15104,59) -> Float(552960,1:4,3840,15) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(709 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.175621 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.112169 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.181312 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.112169 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(552960,1:4,3840,15) -> Float(2174976,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(709 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.666267 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.1124 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.685065 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.1124 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(552960,1:4,3840,15) -> Float(2174976,1,15104,59) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(709 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.145038 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.146798 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.145797 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.145038 [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 712) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.121177 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101634 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.11984 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101634 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 712) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.120421 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101303 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.120405 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101303 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 712) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.244603 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101399 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.263141 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101399 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 712) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0816457 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101285 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0813143 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0813143 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 712) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.254981 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101063 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.289088 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101063 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 712) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0813714 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101273 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0815429 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0813714 [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 716) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0522331 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.044904 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0495848 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.044904 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 716) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0480869 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0456057 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0478507 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0456057 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 716) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.202921 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0448949 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.197673 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0448949 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 716) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.193074 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.152366 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.190949 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.152366 [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.023904 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0405829 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0325376 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.023904 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.051005 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0459829 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0456126 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0456126 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0490072 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0449223 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0487787 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0449223 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.208462 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0450869 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.204411 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0450869 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.112985 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.166158 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.107726 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.107726 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.132462 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100507 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.101781 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100507 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0403737 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100722 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0402103 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0402103 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0435234 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101264 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0438983 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0435234 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.26656 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101017 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.265486 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101017 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.235835 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.630674 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.251296 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.235835 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.104469 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100053 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.111207 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100053 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0436229 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100766 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0436171 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0436171 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0488091 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100834 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0488427 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0488091 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.267095 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100834 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.475886 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100834 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: 714 copy (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.267237 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.629897 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.239557 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.239557 [02/13/2023-19:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:34] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(717 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.120635 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101392 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.120041 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101392 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(717 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.119824 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101906 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.119333 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101906 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(717 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.312096 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101701 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.239301 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101701 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(717 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.081552 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101074 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0812137 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0812137 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(717 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.316169 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101723 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.275611 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101723 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(717 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0815497 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101454 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0815154 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0815154 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(717 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.357143 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.10187 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.272635 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.10187 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(717 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0816183 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101298 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0812731 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0812731 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(717 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0921851 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101305 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.091632 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.091632 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(717 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.128967 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.83597 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.135355 [02/13/2023-19:50:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.128967 [02/13/2023-19:50:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(717 -> ) (Reformat) [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.244407 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 5.64843 [02/13/2023-19:50:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.256183 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.244407 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(717 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.252567 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 5.64873 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.249147 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.249147 [02/13/2023-19:50:35] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(718 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.420741 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101657 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.447579 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101657 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(718 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.387072 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.296128 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.387689 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.296128 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(718 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.550775 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100923 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.550039 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100923 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(718 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.1036 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.615392 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.04955 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.615392 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(718 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.549093 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101278 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.549646 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101278 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(718 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.0794 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.615525 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.08957 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.615525 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(718 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.14931 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.614816 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.14331 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.614816 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(718 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.542976 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 5.65129 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.600814 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.542976 [02/13/2023-19:50:35] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.423506 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101536 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.424009 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101536 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.383877 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.297349 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.385367 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.297349 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.563781 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.10101 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.556722 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.10101 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.10439 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.614267 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.09555 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.614267 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.552293 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100974 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.553211 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100974 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.08806 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.614665 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.05869 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.614665 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.228878 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101495 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.219822 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101495 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0811886 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101019 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0815223 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0811886 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.091888 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101095 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0919589 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.091888 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.04123 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.614587 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.12344 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.614587 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.128725 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.83532 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.133227 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.128725 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.254226 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 5.65001 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.249865 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.249865 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.251881 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 5.64891 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.256306 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.251881 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 719) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.593934 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 5.64909 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.620699 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.593934 [02/13/2023-19:50:35] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(720 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0490743 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0455417 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0530347 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0455417 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(720 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.668453 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100318 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.665819 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100318 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(720 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.108674 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.10005 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.110414 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.10005 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(720 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.044448 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100752 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0448274 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.044448 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(720 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.721381 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100965 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.723365 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100965 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(720 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.151291 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100126 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.105504 [02/13/2023-19:50:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100126 [02/13/2023-19:50:35] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(720 -> ) (Reformat) [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.721527 [02/13/2023-19:50:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101019 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.718464 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101019 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(720 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.122686 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100151 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.144379 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100151 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(720 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0491825 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101141 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0488594 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0488594 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(720 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.067584 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.42181 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0678034 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.067584 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(720 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0746126 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.63483 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0754629 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0746126 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(716 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.742053 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101088 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.717888 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.101088 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 722) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.044312 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100843 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0441703 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0441703 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 722) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0442423 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101518 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0439154 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0439154 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 722) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.232709 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100702 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.229175 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100702 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 722) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.116329 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100382 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.134274 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100382 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 722) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0434949 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.101045 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0434206 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0434206 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 722) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.04848 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100873 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0487848 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.04848 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 722) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.262843 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100777 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.261906 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.100777 [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(589824,1,4096,16) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(721 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0459189 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0458183 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0463623 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0458183 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(721 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.191113 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.152087 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.18976 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.152087 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(721 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.511063 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.645399 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.530162 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.511063 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(721 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.043864 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100857 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0440629 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.043864 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(721 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.547881 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.645024 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.540187 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.540187 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(721 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0443714 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.100578 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.044168 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.044168 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(721 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0762811 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.634592 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0750057 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0750057 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,4096,16) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,1024,4) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(36864,36864:32,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,36864,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1179648,1,8192,32) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(294912,1:4,2048,8) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(589824,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: r1o copy (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0347374 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0401349 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0304 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0304 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(4718592,147456,512,1) -> Float(5160960,147456,512,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 736 copy (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.206761 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.280187 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.230418 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.206761 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(4718592,147456,512,1) -> Float(5160960,1,17920,35) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 736 copy (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.472302 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.380736 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.472375 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.380736 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(4718592,147456,512,1) -> Float(1327104,1:4,4608,9) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 736 copy (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.478053 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.382249 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.476471 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.382249 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(5160960,147456,512,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0169092 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0315163 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0120034 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0120034 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(5160960,1,17920,35) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0610316 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0929303 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0638126 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0610316 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(442368,147456,512,1) -> Float(1327104,1:4,4608,9) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.174875 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0699703 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.176457 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0699703 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(5160960,147456,512,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0250476 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.367662 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0245478 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0245478 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(5160960,1,17920,35) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.071984 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.351794 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0651931 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0651931 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(442368,1,1536,3) -> Float(1327104,1:4,4608,9) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.174629 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.356832 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.17776 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.174629 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(5160960,147456,512,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0300526 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.367803 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0298578 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0298578 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(5160960,1,17920,35) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0751726 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.354459 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.075232 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0751726 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1327104,1:4,4608,9) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.180425 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.362459 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.181349 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.180425 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(5160960,147456,512,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.133922 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.36864 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.104032 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.104032 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(5160960,1,17920,35) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0832389 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.355643 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0826766 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0826766 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(1327104,1:4,4608,9) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.19211 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.362606 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.191557 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.191557 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(5160960,147456,512,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0525349 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.068 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0524008 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0524008 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(5160960,1,17920,35) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.100455 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.4694 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0994514 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0994514 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(1327104,1:4,4608,9) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: 389 copy (1) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.207899 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.52262 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.207616 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.207616 [02/13/2023-19:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:36] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(5160960,147456,512,1) -> Float(5160960,1,17920,35) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(745 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.563081 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.379022 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.562395 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.379022 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(5160960,147456,512,1) -> Float(1327104,1:4,4608,9) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(745 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.698862 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.381769 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.699218 [02/13/2023-19:50:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.381769 [02/13/2023-19:50:36] [V] [TRT] *************** Autotuning Reformat: Float(5160960,1,17920,35) -> Float(5160960,147456,512,1) *************** [02/13/2023-19:50:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(745 -> ) (Reformat) [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 2.04809 [02/13/2023-19:50:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.380146 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.99262 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.380146 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(5160960,1,17920,35) -> Float(1327104,1:4,4608,9) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(745 -> ) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.470121 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.372805 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.469216 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.372805 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(1327104,1:4,4608,9) -> Float(5160960,147456,512,1) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(745 -> ) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.98706 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.388311 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.91733 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.388311 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(1327104,1:4,4608,9) -> Float(5160960,1,17920,35) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(745 -> ) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.334473 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.41024 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.334569 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.334473 [02/13/2023-19:50:37] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(2359296,147456,512,1) -> Float(2359296,1,8192,16) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(748 -> ) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.176818 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.157838 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.184471 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.157838 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(2359296,147456,512,1) -> Float(589824,1:4,2048,4) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(748 -> ) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.178423 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.15776 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.191351 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.15776 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(2359296,1,8192,16) -> Float(2359296,147456,512,1) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(748 -> ) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.741554 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.375474 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.746994 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.375474 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(2359296,1,8192,16) -> Float(589824,1:4,2048,4) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(748 -> ) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.155735 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377481 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.155479 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.155479 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(589824,1:4,2048,4) -> Float(2359296,147456,512,1) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(748 -> ) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.759785 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.375342 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.713669 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.375342 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(589824,1:4,2048,4) -> Float(2359296,1,8192,16) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(748 -> ) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.155707 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377422 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.155995 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.155707 [02/13/2023-19:50:37] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(3538944,147456,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 751) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.203529 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.171278 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.209582 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.171278 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(3538944,147456,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 751) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.211122 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.170217 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.214971 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.170217 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(3538944,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 751) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.80232 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.376859 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.79822 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.376859 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(3538944,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 751) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.779973 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.586066 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.788197 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.586066 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(3538944,1,12288,24) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 751) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.784896 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.375877 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.974231 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.375877 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(3538944,1,12288,24) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 751) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.198775 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377614 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.185408 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.185408 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(3538944,1,12288,24) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 751) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 2.22173 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.37744 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.21304 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.37744 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(3538944,1,12288,24) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 751) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 2.26457 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.55937 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.26665 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 2.26457 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(884736,1:4,3072,6) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 751) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.755557 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.37589 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.806629 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.37589 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(884736,1:4,3072,6) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 751) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.171022 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377646 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.172361 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.171022 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(884736,1:4,3072,6) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 751) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 2.26054 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377093 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.26335 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.377093 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(884736,1:4,3072,6) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 751) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 2.31938 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.56052 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.33024 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 2.31938 [02/13/2023-19:50:37] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(3538944,147456,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(751 -> ) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.178135 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.156933 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.172786 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.156933 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(3538944,147456,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(751 -> ) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.178798 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.158171 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.171392 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.158171 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(3538944,1,12288,24) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(751 -> ) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.956375 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.375067 [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.964827 [02/13/2023-19:50:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.375067 [02/13/2023-19:50:37] [V] [TRT] *************** Autotuning Reformat: Float(3538944,1,12288,24) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(751 -> ) (Reformat) [02/13/2023-19:50:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.157513 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.376983 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.157111 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.157111 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(884736,1:4,3072,6) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(751 -> ) (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.917033 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.375131 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.884032 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.375131 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(884736,1:4,3072,6) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(751 -> ) (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.157829 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377349 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.158254 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.157829 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(751 -> ) (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.805627 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.375456 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.825527 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.375456 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(751 -> ) (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.158491 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.376933 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.156846 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.156846 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(751 -> ) (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.176946 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377458 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.177093 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.176946 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(751 -> ) (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.252439 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 5.6613 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.254121 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.252439 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(751 -> ) (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.364027 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.51696 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.386089 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.364027 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(751 -> ) (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.325445 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.51801 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.316713 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.316713 [02/13/2023-19:50:38] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 753 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0158117 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0296357 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0168046 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0158117 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 753 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0365977 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0444274 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0363714 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0363714 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 753 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0305637 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0447943 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0304082 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0304082 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 753 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.175735 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0934354 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.180187 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0934354 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 753 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0248808 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.369463 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0249646 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0248808 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 753 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0352731 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.351255 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0347072 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0347072 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 753 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.038544 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.351461 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0384617 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0384617 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 753 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.18597 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.352293 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.196018 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.18597 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 754 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00886615 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130905 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00682906 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00682906 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 754 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157989 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0440994 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0183851 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0157989 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 754 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0153207 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0439669 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0153883 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0153207 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 754 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.22698 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.372782 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.22459 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.372782 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 754 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.011559 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.360585 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0115552 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0115552 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 754 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0346606 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.343703 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.038184 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0346606 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 754 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0304713 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.343835 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0305115 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0304713 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 754 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.24113 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.363739 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.2397 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.363739 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 754 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0127832 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.360014 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0126968 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0126968 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 754 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0327433 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.344539 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0320338 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0320338 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 754 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0336375 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.342295 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0331136 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0331136 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 754 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.24063 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.363465 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.24169 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.363465 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:38] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0240023 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0414149 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0296677 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0240023 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0795131 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0770446 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0826537 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0770446 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0779909 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0752891 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0820983 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0752891 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.223666 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.07208 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.231328 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.07208 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.113051 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.16256 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.111561 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.111561 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0323163 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.37312 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0316681 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0316681 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0710766 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.373481 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0703558 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0703558 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0710781 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.373559 [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0695299 [02/13/2023-19:50:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0695299 [02/13/2023-19:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:38] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:38] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.240622 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.371305 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.223589 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.223589 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.133833 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.50808 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.133243 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.133243 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.038592 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.37312 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0369966 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0369966 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0725829 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.374866 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0710095 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0710095 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0714606 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.372695 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.073312 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0714606 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.229993 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.371694 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.237175 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.229993 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.12955 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.50357 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.127835 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.127835 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.156347 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.373024 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.165413 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.156347 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0962949 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377618 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0969074 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0962949 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0958149 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.376873 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0965691 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0958149 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.266208 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.376791 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.265239 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.265239 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.267136 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.50584 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.264549 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.264549 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0678705 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.42173 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0676602 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0676602 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.119993 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.52597 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.120055 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.119993 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.119563 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.52262 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.119792 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.119563 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.263392 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.52249 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.260261 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.260261 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: 765 copy (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.17957 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.36589 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.181408 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.17957 [02/13/2023-19:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [02/13/2023-19:50:39] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(3538944,147456,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(770 -> ) (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.296686 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.37861 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.294935 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.294935 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(3538944,147456,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(770 -> ) (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.303429 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.378597 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.290235 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.290235 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(3538944,1,12288,24) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(770 -> ) (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.33496 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377298 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.28713 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.377298 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(3538944,1,12288,24) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(770 -> ) (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.22933 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.378386 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.230098 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.22933 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(884736,1:4,3072,6) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(770 -> ) (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.30058 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377115 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.31247 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.377115 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(884736,1:4,3072,6) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(770 -> ) (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.230295 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.378213 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.229289 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.229289 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(770 -> ) (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.15658 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.376933 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.18277 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.376933 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(770 -> ) (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.230098 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377915 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.230057 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.230057 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(770 -> ) (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.260983 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377856 [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.260987 [02/13/2023-19:50:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.260983 [02/13/2023-19:50:39] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:50:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(770 -> ) (Reformat) [02/13/2023-19:50:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.440457 [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.48629 [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.431296 [02/13/2023-19:50:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.431296 [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:50:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(770 -> ) (Reformat) [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.557701 [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 22.5586 [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.544379 [02/13/2023-19:50:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.544379 [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:50:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(770 -> ) (Reformat) [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.553435 [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 22.5613 [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.556992 [02/13/2023-19:50:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.553435 [02/13/2023-19:50:40] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(2359296,147456,512,1) -> Float(2359296,1,8192,16) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(2359296,147456,512,1) -> Float(589824,1:4,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(2359296,1,8192,16) -> Float(2359296,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(2359296,1,8192,16) -> Float(589824,1:4,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1:4,2048,4) -> Float(2359296,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1:4,2048,4) -> Float(2359296,1,8192,16) *************** [02/13/2023-19:50:40] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(2359296,147456,512,1) -> Float(2359296,1,8192,16) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(2359296,147456,512,1) -> Float(589824,1:4,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(2359296,1,8192,16) -> Float(2359296,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(2359296,1,8192,16) -> Float(589824,1:4,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1:4,2048,4) -> Float(2359296,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1:4,2048,4) -> Float(2359296,1,8192,16) *************** [02/13/2023-19:50:40] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,1,2048,4) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:40] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:50:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 793) (Reformat) [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.947314 [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.918939 [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.950871 [02/13/2023-19:50:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.918939 [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:50:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 793) (Reformat) [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.01253 [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.919538 [02/13/2023-19:50:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.01335 [02/13/2023-19:50:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.919538 [02/13/2023-19:50:40] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:50:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 793) (Reformat) [02/13/2023-19:50:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 84.4664 [02/13/2023-19:50:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.179 [02/13/2023-19:50:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 84.4539 [02/13/2023-19:50:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 9.179 [02/13/2023-19:50:42] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:50:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 793) (Reformat) [02/13/2023-19:50:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 5.04109 [02/13/2023-19:50:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 3.58088 [02/13/2023-19:50:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 5.07183 [02/13/2023-19:50:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 3.58088 [02/13/2023-19:50:42] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:42] [V] [TRT] *************** Autotuning Reformat: Float(589824,1,2048,4) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:42] [V] [TRT] *************** Autotuning Reformat: Float(147456,1:4,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:42] [V] [TRT] *************** Autotuning Reformat: Float(147456,147456:32,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:42] [V] [TRT] *************** Autotuning Reformat: Float(1:4,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:50:42] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:42] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:50:42] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:50:42] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:50:42] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:50:42] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:50:42] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:50:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.961381 [02/13/2023-19:50:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.925253 [02/13/2023-19:50:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.959474 [02/13/2023-19:50:43] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.925253 [02/13/2023-19:50:43] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:50:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.00865 [02/13/2023-19:50:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.919753 [02/13/2023-19:50:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.01568 [02/13/2023-19:50:43] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.919753 [02/13/2023-19:50:43] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:50:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 84.4501 [02/13/2023-19:50:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.18222 [02/13/2023-19:50:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 84.4362 [02/13/2023-19:50:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 9.18222 [02/13/2023-19:50:45] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:50:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 5.03614 [02/13/2023-19:50:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 3.581 [02/13/2023-19:50:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 5.02699 [02/13/2023-19:50:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 3.581 [02/13/2023-19:50:45] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:50:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.66438 [02/13/2023-19:50:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.17196 [02/13/2023-19:50:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.70421 [02/13/2023-19:50:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.66438 [02/13/2023-19:50:45] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:50:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.931305 [02/13/2023-19:50:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.18713 [02/13/2023-19:50:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.930821 [02/13/2023-19:50:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.930821 [02/13/2023-19:50:45] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:50:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 85.1474 [02/13/2023-19:50:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.22523 [02/13/2023-19:50:47] [V] [TRT] Tactic: 0x0000000000000000 Time: 85.052 [02/13/2023-19:50:47] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 9.22523 [02/13/2023-19:50:47] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:50:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:47] [V] [TRT] Tactic: 0x00000000000003e8 Time: 11.5342 [02/13/2023-19:50:48] [V] [TRT] Tactic: 0x00000000000003ea Time: 64.297 [02/13/2023-19:50:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 11.4377 [02/13/2023-19:50:48] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 11.4377 [02/13/2023-19:50:48] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:50:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:48] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.71183 [02/13/2023-19:50:48] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.12794 [02/13/2023-19:50:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.64118 [02/13/2023-19:50:48] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.64118 [02/13/2023-19:50:48] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:50:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:48] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.930254 [02/13/2023-19:50:48] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.187 [02/13/2023-19:50:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.930734 [02/13/2023-19:50:48] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.930254 [02/13/2023-19:50:48] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:50:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:49] [V] [TRT] Tactic: 0x00000000000003e8 Time: 85.1032 [02/13/2023-19:50:49] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.22579 [02/13/2023-19:50:50] [V] [TRT] Tactic: 0x0000000000000000 Time: 85.0938 [02/13/2023-19:50:50] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 9.22579 [02/13/2023-19:50:50] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:50:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:50] [V] [TRT] Tactic: 0x00000000000003e8 Time: 11.5022 [02/13/2023-19:50:51] [V] [TRT] Tactic: 0x00000000000003ea Time: 64.2978 [02/13/2023-19:50:51] [V] [TRT] Tactic: 0x0000000000000000 Time: 11.4493 [02/13/2023-19:50:51] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 11.4493 [02/13/2023-19:50:51] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:50:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:51] [V] [TRT] Tactic: 0x00000000000003e8 Time: 4.16322 [02/13/2023-19:50:52] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.13061 [02/13/2023-19:50:52] [V] [TRT] Tactic: 0x0000000000000000 Time: 4.86052 [02/13/2023-19:50:52] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 4.16322 [02/13/2023-19:50:52] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:50:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:52] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.30787 [02/13/2023-19:50:52] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.19177 [02/13/2023-19:50:52] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.30742 [02/13/2023-19:50:52] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.30742 [02/13/2023-19:50:52] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:50:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:52] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.3258 [02/13/2023-19:50:53] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.19204 [02/13/2023-19:50:53] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.32377 [02/13/2023-19:50:53] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.32377 [02/13/2023-19:50:53] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:50:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:53] [V] [TRT] Tactic: 0x00000000000003e8 Time: 16.5833 [02/13/2023-19:50:54] [V] [TRT] Tactic: 0x00000000000003ea Time: 64.253 [02/13/2023-19:50:54] [V] [TRT] Tactic: 0x0000000000000000 Time: 16.0131 [02/13/2023-19:50:54] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 16.0131 [02/13/2023-19:50:54] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:50:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:54] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.71265 [02/13/2023-19:50:54] [V] [TRT] Tactic: 0x00000000000003ea Time: 35.3193 [02/13/2023-19:50:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.69954 [02/13/2023-19:50:55] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.69954 [02/13/2023-19:50:55] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:50:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:55] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.77369 [02/13/2023-19:50:55] [V] [TRT] Tactic: 0x00000000000003ea Time: 62.8669 [02/13/2023-19:50:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.78586 [02/13/2023-19:50:55] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.77369 [02/13/2023-19:50:55] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:50:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:55] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.74666 [02/13/2023-19:50:56] [V] [TRT] Tactic: 0x00000000000003ea Time: 62.8693 [02/13/2023-19:50:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.76092 [02/13/2023-19:50:56] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.74666 [02/13/2023-19:50:56] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:50:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(793 -> ) (Reformat) [02/13/2023-19:50:57] [V] [TRT] Tactic: 0x00000000000003e8 Time: 85.1648 [02/13/2023-19:51:02] [V] [TRT] Tactic: 0x00000000000003ea Time: 563.432 [02/13/2023-19:51:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 85.3617 [02/13/2023-19:51:03] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 85.1648 [02/13/2023-19:51:03] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:03] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.64953 [02/13/2023-19:51:03] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.12865 [02/13/2023-19:51:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.63131 [02/13/2023-19:51:03] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.63131 [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:03] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.930405 [02/13/2023-19:51:03] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.1873 [02/13/2023-19:51:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.931209 [02/13/2023-19:51:03] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.930405 [02/13/2023-19:51:03] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:04] [V] [TRT] Tactic: 0x00000000000003e8 Time: 85.1323 [02/13/2023-19:51:04] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.22652 [02/13/2023-19:51:05] [V] [TRT] Tactic: 0x0000000000000000 Time: 85.1256 [02/13/2023-19:51:05] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 9.22652 [02/13/2023-19:51:05] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:05] [V] [TRT] Tactic: 0x00000000000003e8 Time: 11.4765 [02/13/2023-19:51:06] [V] [TRT] Tactic: 0x00000000000003ea Time: 64.3342 [02/13/2023-19:51:06] [V] [TRT] Tactic: 0x0000000000000000 Time: 11.4396 [02/13/2023-19:51:06] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 11.4396 [02/13/2023-19:51:06] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:06] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.69697 [02/13/2023-19:51:06] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.12833 [02/13/2023-19:51:06] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.70272 [02/13/2023-19:51:06] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.69697 [02/13/2023-19:51:06] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:06] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.930679 [02/13/2023-19:51:06] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.18695 [02/13/2023-19:51:06] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.929669 [02/13/2023-19:51:06] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.929669 [02/13/2023-19:51:06] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:07] [V] [TRT] Tactic: 0x00000000000003e8 Time: 85.0133 [02/13/2023-19:51:07] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.22794 [02/13/2023-19:51:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 85.0956 [02/13/2023-19:51:08] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 9.22794 [02/13/2023-19:51:08] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:08] [V] [TRT] Tactic: 0x00000000000003e8 Time: 11.458 [02/13/2023-19:51:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 64.3497 [02/13/2023-19:51:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 11.4638 [02/13/2023-19:51:09] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 11.458 [02/13/2023-19:51:09] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 4.16902 [02/13/2023-19:51:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.12798 [02/13/2023-19:51:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 4.15555 [02/13/2023-19:51:09] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 4.15555 [02/13/2023-19:51:09] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:10] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.30285 [02/13/2023-19:51:10] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.19249 [02/13/2023-19:51:10] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.30726 [02/13/2023-19:51:10] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.30285 [02/13/2023-19:51:10] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:10] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.32643 [02/13/2023-19:51:10] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.19227 [02/13/2023-19:51:10] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.32569 [02/13/2023-19:51:10] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.32569 [02/13/2023-19:51:10] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:11] [V] [TRT] Tactic: 0x00000000000003e8 Time: 15.9564 [02/13/2023-19:51:11] [V] [TRT] Tactic: 0x00000000000003ea Time: 64.299 [02/13/2023-19:51:12] [V] [TRT] Tactic: 0x0000000000000000 Time: 15.8944 [02/13/2023-19:51:12] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 15.8944 [02/13/2023-19:51:12] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:12] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.72135 [02/13/2023-19:51:12] [V] [TRT] Tactic: 0x00000000000003ea Time: 35.3635 [02/13/2023-19:51:12] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.76568 [02/13/2023-19:51:12] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.72135 [02/13/2023-19:51:12] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:12] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.76671 [02/13/2023-19:51:13] [V] [TRT] Tactic: 0x00000000000003ea Time: 62.9281 [02/13/2023-19:51:13] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.81845 [02/13/2023-19:51:13] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.76671 [02/13/2023-19:51:13] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:13] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.78331 [02/13/2023-19:51:14] [V] [TRT] Tactic: 0x00000000000003ea Time: 63.1517 [02/13/2023-19:51:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.77379 [02/13/2023-19:51:14] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.77379 [02/13/2023-19:51:14] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> 809) (Reformat) [02/13/2023-19:51:15] [V] [TRT] Tactic: 0x00000000000003e8 Time: 85.2447 [02/13/2023-19:51:19] [V] [TRT] Tactic: 0x00000000000003ea Time: 563.099 [02/13/2023-19:51:20] [V] [TRT] Tactic: 0x0000000000000000 Time: 85.2884 [02/13/2023-19:51:20] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 85.2447 [02/13/2023-19:51:20] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:51:20] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:20] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.685422 [02/13/2023-19:51:20] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.981051 [02/13/2023-19:51:20] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.689463 [02/13/2023-19:51:20] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.685422 [02/13/2023-19:51:20] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:20] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.67046 [02/13/2023-19:51:20] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.917408 [02/13/2023-19:51:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.66258 [02/13/2023-19:51:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.917408 [02/13/2023-19:51:21] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 85.9996 [02/13/2023-19:51:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.18219 [02/13/2023-19:51:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 86.9689 [02/13/2023-19:51:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 9.18219 [02/13/2023-19:51:22] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.64364 [02/13/2023-19:51:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.72123 [02/13/2023-19:51:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.67582 [02/13/2023-19:51:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 2.72123 [02/13/2023-19:51:23] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.1707 [02/13/2023-19:51:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.02225 [02/13/2023-19:51:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.23531 [02/13/2023-19:51:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.1707 [02/13/2023-19:51:23] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.72151 [02/13/2023-19:51:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.84128 [02/13/2023-19:51:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.71813 [02/13/2023-19:51:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.71813 [02/13/2023-19:51:23] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 86.5036 [02/13/2023-19:51:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.91956 [02/13/2023-19:51:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 86.5328 [02/13/2023-19:51:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 8.91956 [02/13/2023-19:51:25] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 8.49642 [02/13/2023-19:51:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 63.2177 [02/13/2023-19:51:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 8.72716 [02/13/2023-19:51:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 8.49642 [02/13/2023-19:51:26] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.21498 [02/13/2023-19:51:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.02327 [02/13/2023-19:51:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.19342 [02/13/2023-19:51:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.19342 [02/13/2023-19:51:26] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.719429 [02/13/2023-19:51:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.72595 [02/13/2023-19:51:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.724338 [02/13/2023-19:51:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.719429 [02/13/2023-19:51:26] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 86.5079 [02/13/2023-19:51:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.91417 [02/13/2023-19:51:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 86.5549 [02/13/2023-19:51:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 8.91417 [02/13/2023-19:51:28] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 8.49911 [02/13/2023-19:51:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 63.2211 [02/13/2023-19:51:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 8.25372 [02/13/2023-19:51:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 8.25372 [02/13/2023-19:51:29] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.03298 [02/13/2023-19:51:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.02187 [02/13/2023-19:51:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.52488 [02/13/2023-19:51:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 3.03298 [02/13/2023-19:51:29] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.13965 [02/13/2023-19:51:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.6823 [02/13/2023-19:51:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.14138 [02/13/2023-19:51:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.13965 [02/13/2023-19:51:30] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 2.57373 [02/13/2023-19:51:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.84822 [02/13/2023-19:51:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.47879 [02/13/2023-19:51:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 2.47879 [02/13/2023-19:51:30] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 11.9242 [02/13/2023-19:51:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 63.0477 [02/13/2023-19:51:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 11.5378 [02/13/2023-19:51:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 11.5378 [02/13/2023-19:51:31] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.25225 [02/13/2023-19:51:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 26.5718 [02/13/2023-19:51:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.26005 [02/13/2023-19:51:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.25225 [02/13/2023-19:51:32] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.28019 [02/13/2023-19:51:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 61.8341 [02/13/2023-19:51:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.31884 [02/13/2023-19:51:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.28019 [02/13/2023-19:51:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 2.3689 [02/13/2023-19:51:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 63.1728 [02/13/2023-19:51:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.3627 [02/13/2023-19:51:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 2.3627 [02/13/2023-19:51:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(810 -> ) (Reformat) [02/13/2023-19:51:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 86.5239 [02/13/2023-19:51:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 564.272 [02/13/2023-19:51:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 86.4801 [02/13/2023-19:51:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 86.4801 [02/13/2023-19:51:40] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:51:40] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(11059200,1,7680,3) *************** [02/13/2023-19:51:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:51:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.684645 [02/13/2023-19:51:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.981326 [02/13/2023-19:51:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.681225 [02/13/2023-19:51:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.681225 [02/13/2023-19:51:40] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:51:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.68687 [02/13/2023-19:51:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.916137 [02/13/2023-19:51:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.68656 [02/13/2023-19:51:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.916137 [02/13/2023-19:51:40] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:51:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 86.0395 [02/13/2023-19:51:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.20528 [02/13/2023-19:51:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 86.0088 [02/13/2023-19:51:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 9.20528 [02/13/2023-19:51:42] [V] [TRT] *************** Autotuning Reformat: Float(11059200,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:51:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.67408 [02/13/2023-19:51:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 2.72027 [02/13/2023-19:51:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.68104 [02/13/2023-19:51:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 2.72027 [02/13/2023-19:51:42] [V] [TRT] *************** Autotuning Reformat: Float(11059200,1,7680,3) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:51:42] [V] [TRT] *************** Autotuning Reformat: Float(11059200,1,7680,3) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:51:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.56228 [02/13/2023-19:51:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.85515 [02/13/2023-19:51:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.56577 [02/13/2023-19:51:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.56228 [02/13/2023-19:51:42] [V] [TRT] *************** Autotuning Reformat: Float(11059200,1,7680,3) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:51:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 86.2726 [02/13/2023-19:51:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.86886 [02/13/2023-19:51:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 86.3878 [02/13/2023-19:51:44] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 8.86886 [02/13/2023-19:51:44] [V] [TRT] *************** Autotuning Reformat: Float(11059200,1,7680,3) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:51:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 7.8624 [02/13/2023-19:51:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 63.1938 [02/13/2023-19:51:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 8.30526 [02/13/2023-19:51:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 7.8624 [02/13/2023-19:51:45] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:51:45] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(11059200,1,7680,3) *************** [02/13/2023-19:51:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:51:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.719584 [02/13/2023-19:51:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.82384 [02/13/2023-19:51:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.726766 [02/13/2023-19:51:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.719584 [02/13/2023-19:51:45] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:45] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:45] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:51:45] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(11059200,1,7680,3) *************** [02/13/2023-19:51:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:51:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.1475 [02/13/2023-19:51:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.78575 [02/13/2023-19:51:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.14442 [02/13/2023-19:51:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.14442 [02/13/2023-19:51:46] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:46] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:46] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:51:46] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(11059200,1,7680,3) *************** [02/13/2023-19:51:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(Reformatted src -> ) (Reformat) [02/13/2023-19:51:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.33926 [02/13/2023-19:51:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 61.7232 [02/13/2023-19:51:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.34012 [02/13/2023-19:51:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.33926 [02/13/2023-19:51:46] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:46] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:46] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:51:46] [V] [TRT] *************** Autotuning Reformat: Float(11059200,1,7680,3) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:51:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> fgr) (Reformat) [02/13/2023-19:51:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.01179 [02/13/2023-19:51:47] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.17805 [02/13/2023-19:51:47] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.999977 [02/13/2023-19:51:47] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.999977 [02/13/2023-19:51:47] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:51:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> fgr) (Reformat) [02/13/2023-19:51:47] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.24536 [02/13/2023-19:51:47] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.19653 [02/13/2023-19:51:47] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.2446 [02/13/2023-19:51:47] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.2446 [02/13/2023-19:51:47] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:51:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> fgr) (Reformat) [02/13/2023-19:51:47] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.76083 [02/13/2023-19:51:47] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.1011 [02/13/2023-19:51:47] [V] [TRT] Tactic: 0x0000000000000000 Time: 4.01276 [02/13/2023-19:51:47] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 3.76083 [02/13/2023-19:51:47] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:51:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> fgr) (Reformat) [02/13/2023-19:51:47] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.23675 [02/13/2023-19:51:48] [V] [TRT] Tactic: 0x00000000000003ea Time: 26.7537 [02/13/2023-19:51:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.22671 [02/13/2023-19:51:48] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.22671 [02/13/2023-19:51:48] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:51:48] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:48] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.215845 [02/13/2023-19:51:48] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.22101 [02/13/2023-19:51:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.215927 [02/13/2023-19:51:48] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.215845 [02/13/2023-19:51:48] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:48] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.22783 [02/13/2023-19:51:48] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.911662 [02/13/2023-19:51:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.21128 [02/13/2023-19:51:48] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.911662 [02/13/2023-19:51:48] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:49] [V] [TRT] Tactic: 0x00000000000003e8 Time: 89.1354 [02/13/2023-19:51:49] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.20111 [02/13/2023-19:51:50] [V] [TRT] Tactic: 0x0000000000000000 Time: 89.1337 [02/13/2023-19:51:50] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 9.20111 [02/13/2023-19:51:50] [V] [TRT] *************** Autotuning Reformat: Float(14745600,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:50] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.21098 [02/13/2023-19:51:50] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.912146 [02/13/2023-19:51:50] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.21008 [02/13/2023-19:51:50] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.912146 [02/13/2023-19:51:50] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:50] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.45248 [02/13/2023-19:51:50] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.87754 [02/13/2023-19:51:50] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.463607 [02/13/2023-19:51:50] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.45248 [02/13/2023-19:51:50] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:50] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.55447 [02/13/2023-19:51:50] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.90979 [02/13/2023-19:51:50] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.54921 [02/13/2023-19:51:50] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.54921 [02/13/2023-19:51:50] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:51] [V] [TRT] Tactic: 0x00000000000003e8 Time: 89.3647 [02/13/2023-19:51:51] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.81546 [02/13/2023-19:51:52] [V] [TRT] Tactic: 0x0000000000000000 Time: 90.1203 [02/13/2023-19:51:52] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 8.81546 [02/13/2023-19:51:52] [V] [TRT] *************** Autotuning Reformat: Float(14745600,1,10240,4) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:52] [V] [TRT] Tactic: 0x00000000000003e8 Time: 2.74058 [02/13/2023-19:51:53] [V] [TRT] Tactic: 0x00000000000003ea Time: 62.9003 [02/13/2023-19:51:53] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.74612 [02/13/2023-19:51:53] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 2.74058 [02/13/2023-19:51:53] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:53] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.387442 [02/13/2023-19:51:53] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.99525 [02/13/2023-19:51:53] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.386089 [02/13/2023-19:51:53] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.386089 [02/13/2023-19:51:53] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:53] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.403931 [02/13/2023-19:51:53] [V] [TRT] Tactic: 0x00000000000003ea Time: 9.02211 [02/13/2023-19:51:53] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.393079 [02/13/2023-19:51:53] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.393079 [02/13/2023-19:51:53] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:53] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.53027 [02/13/2023-19:51:53] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.90178 [02/13/2023-19:51:53] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.54139 [02/13/2023-19:51:53] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.53027 [02/13/2023-19:51:53] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:54] [V] [TRT] Tactic: 0x00000000000003e8 Time: 89.3121 [02/13/2023-19:51:54] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.82643 [02/13/2023-19:51:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 89.3236 [02/13/2023-19:51:55] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 8.82643 [02/13/2023-19:51:55] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:51:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:55] [V] [TRT] Tactic: 0x00000000000003e8 Time: 2.68001 [02/13/2023-19:51:56] [V] [TRT] Tactic: 0x00000000000003ea Time: 62.898 [02/13/2023-19:51:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.68312 [02/13/2023-19:51:56] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 2.68001 [02/13/2023-19:51:56] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:51:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:56] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.35131 [02/13/2023-19:51:56] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.9716 [02/13/2023-19:51:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.25827 [02/13/2023-19:51:56] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.25827 [02/13/2023-19:51:56] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:51:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:56] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.16712 [02/13/2023-19:51:57] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.95112 [02/13/2023-19:51:57] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.16638 [02/13/2023-19:51:57] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 1.16638 [02/13/2023-19:51:57] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:51:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:57] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.05053 [02/13/2023-19:51:57] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.75378 [02/13/2023-19:51:57] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.83243 [02/13/2023-19:51:57] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 2.83243 [02/13/2023-19:51:57] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:51:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:51:58] [V] [TRT] Tactic: 0x00000000000003e8 Time: 90.1368 [02/13/2023-19:51:58] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.80385 [02/13/2023-19:51:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 89.7406 [02/13/2023-19:52:00] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 8.80385 [02/13/2023-19:52:00] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:52:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:52:00] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.64187 [02/13/2023-19:52:00] [V] [TRT] Tactic: 0x00000000000003ea Time: 62.741 [02/13/2023-19:52:00] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.62468 [02/13/2023-19:52:00] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 3.62468 [02/13/2023-19:52:00] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:52:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:52:01] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.386414 [02/13/2023-19:52:01] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.9433 [02/13/2023-19:52:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.387136 [02/13/2023-19:52:01] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.386414 [02/13/2023-19:52:01] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:52:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:52:01] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.389381 [02/13/2023-19:52:01] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.9661 [02/13/2023-19:52:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.387145 [02/13/2023-19:52:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.387145 [02/13/2023-19:52:01] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:52:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:52:01] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.53575 [02/13/2023-19:52:02] [V] [TRT] Tactic: 0x00000000000003ea Time: 62.9099 [02/13/2023-19:52:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.54122 [02/13/2023-19:52:02] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.53575 [02/13/2023-19:52:02] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:52:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(811 -> ) (Reformat) [02/13/2023-19:52:03] [V] [TRT] Tactic: 0x00000000000003e8 Time: 89.2194 [02/13/2023-19:52:07] [V] [TRT] Tactic: 0x00000000000003ea Time: 564.231 [02/13/2023-19:52:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 89.2422 [02/13/2023-19:52:08] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 89.2194 [02/13/2023-19:52:08] [V] [TRT] =============== Computing reformatting costs [02/13/2023-19:52:08] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1,2560,1) -> Float(3686400,3686400,2560,1) *************** [02/13/2023-19:52:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> pha) (Reformat) [02/13/2023-19:52:08] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.206606 [02/13/2023-19:52:08] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.220754 [02/13/2023-19:52:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.206331 [02/13/2023-19:52:08] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.206331 [02/13/2023-19:52:08] [V] [TRT] *************** Autotuning Reformat: Float(3686400,1:4,2560,1) -> Float(3686400,3686400,2560,1) *************** [02/13/2023-19:52:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> pha) (Reformat) [02/13/2023-19:52:08] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.420485 [02/13/2023-19:52:08] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.87721 [02/13/2023-19:52:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.412805 [02/13/2023-19:52:08] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.412805 [02/13/2023-19:52:08] [V] [TRT] *************** Autotuning Reformat: Float(3686400,3686400:32,2560,1) -> Float(3686400,3686400,2560,1) *************** [02/13/2023-19:52:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> pha) (Reformat) [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.00443 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.99379 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.17087 [02/13/2023-19:52:09] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 1.00443 [02/13/2023-19:52:09] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3686400,2560,1) -> Float(3686400,3686400,2560,1) *************** [02/13/2023-19:52:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> pha) (Reformat) [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.443813 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x00000000000003ea Time: 8.87167 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.44203 [02/13/2023-19:52:09] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.44203 [02/13/2023-19:52:09] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:09] [V] [TRT] *************** Autotuning format combination: -> Float(3,1,1,1) *************** [02/13/2023-19:52:09] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:09] [V] [TRT] *************** Autotuning format combination: -> Float(3,1,1,1) *************** [02/13/2023-19:52:09] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:09] [V] [TRT] *************** Autotuning format combination: Float(11059200,3686400,2560,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:52:09] [V] [TRT] --------------- Timing Runner: Resize_3 (Resize) [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0635048 [02/13/2023-19:52:09] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0635048 [02/13/2023-19:52:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 [02/13/2023-19:52:09] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:09] [V] [TRT] *************** Autotuning format combination: Float(11059200,3686400,2560,1) -> Float(3686400,3686400,2560,1) *************** [02/13/2023-19:52:09] [V] [TRT] --------------- Timing Runner: ReduceMean_296 (Reduce) [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.04925 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.815145 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.813353 [02/13/2023-19:52:09] [V] [TRT] Fastest Tactic: 0x0000000000000008 Time: 0.813353 [02/13/2023-19:52:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000008 [02/13/2023-19:52:09] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:09] [V] [TRT] *************** Autotuning format combination: Float(442368,147456,512,1) -> Float(2174976,36864,256,1) *************** [02/13/2023-19:52:09] [V] [TRT] --------------- Timing Runner: AveragePool_169 (TiledPooling) [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710101 Time: 0.494496 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710102 Time: 0.252398 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710104 Time: 0.130441 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710107 Time: 0.0771497 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710108 Time: 0.0677821 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071010f Time: 0.0393577 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710110 Time: 0.0354734 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071011f Time: 0.0284267 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710120 Time: 0.0255733 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710201 Time: 0.237019 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710202 Time: 0.126839 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710204 Time: 0.0684861 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710207 Time: 0.0410731 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710208 Time: 0.0351717 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071020f Time: 0.0284206 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710210 Time: 0.0258834 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071021f Time: 0.0286674 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710220 Time: 0.0263787 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710301 Time: 0.160823 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710302 Time: 0.0871017 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710304 Time: 0.0458286 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710307 Time: 0.0306688 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710308 Time: 0.0264076 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071030f Time: 0.0296201 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710310 Time: 0.0266103 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071031f Time: 0.0304311 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710320 Time: 0.0265958 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710401 Time: 0.120891 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710402 Time: 0.0662232 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710404 Time: 0.0357211 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710407 Time: 0.0285562 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710408 Time: 0.0260731 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071040f Time: 0.0286619 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710410 Time: 0.0263992 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071041f Time: 0.0305874 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710420 Time: 0.0284754 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710501 Time: 0.0969371 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710502 Time: 0.0554651 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710504 Time: 0.0307886 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710507 Time: 0.0307922 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710508 Time: 0.0285158 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071050f Time: 0.0326363 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710510 Time: 0.0285135 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071051f Time: 0.0368949 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710520 Time: 0.0327753 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710601 Time: 0.0801394 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710602 Time: 0.0469177 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710604 Time: 0.0265371 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710607 Time: 0.0306853 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710608 Time: 0.0265006 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071060f Time: 0.0304329 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710610 Time: 0.0265417 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071061f Time: 0.034731 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710620 Time: 0.0306907 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710701 Time: 0.0714926 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710702 Time: 0.041176 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710704 Time: 0.0286382 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710707 Time: 0.0306578 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710708 Time: 0.0264914 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071070f Time: 0.0327305 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710710 Time: 0.0290999 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071071f Time: 0.0496655 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710720 Time: 0.0446674 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710801 Time: 0.0556297 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710802 Time: 0.0361531 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710804 Time: 0.0263322 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710807 Time: 0.0265333 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710808 Time: 0.0264305 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071080f Time: 0.0306048 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710810 Time: 0.0285402 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071081f Time: 0.0474126 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710820 Time: 0.0412286 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710901 Time: 0.0601768 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710902 Time: 0.0348096 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710904 Time: 0.0306615 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710907 Time: 0.0264091 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710908 Time: 0.0285402 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x000000000071090f Time: 0.0370423 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710910 Time: 0.0346405 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710a01 Time: 0.0577234 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710a02 Time: 0.0326967 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710a04 Time: 0.0286601 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710a07 Time: 0.0303625 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710a08 Time: 0.0299877 [02/13/2023-19:52:09] [V] [TRT] Tactic: 0x0000000000710a0f Time: 0.0372549 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710a10 Time: 0.0340407 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b01 Time: 0.0537646 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b02 Time: 0.0305015 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b04 Time: 0.0306981 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b07 Time: 0.0326702 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b08 Time: 0.0286071 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b0f Time: 0.0387554 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b10 Time: 0.0329088 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c01 Time: 0.0474286 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c02 Time: 0.0267116 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c04 Time: 0.026477 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c07 Time: 0.0286043 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c08 Time: 0.0265638 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c0f Time: 0.0345243 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c10 Time: 0.0305737 [02/13/2023-19:52:10] [V] [TRT] Fastest Tactic: 0x0000000000710120 Time: 0.0255733 [02/13/2023-19:52:10] [V] [TRT] --------------- Timing Runner: AveragePool_169 (CudnnPooling) [02/13/2023-19:52:10] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.0158327 [02/13/2023-19:52:10] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.0158327 [02/13/2023-19:52:10] [V] [TRT] --------------- Timing Runner: AveragePool_169 (CaskPooling) [02/13/2023-19:52:10] [V] [TRT] AveragePool_169 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Average_FastDiv Tactic: 0x933eceba7b866d59 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x933eceba7b866d59 Time: 0.0160005 [02/13/2023-19:52:10] [V] [TRT] Fastest Tactic: 0x933eceba7b866d59 Time: 0.0160005 [02/13/2023-19:52:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: 0xffffffffffffffff [02/13/2023-19:52:10] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,512,1) -> Float(552960,1:4,3840,15) *************** [02/13/2023-19:52:10] [V] [TRT] --------------- Timing Runner: AveragePool_169 (CaskPooling) [02/13/2023-19:52:10] [V] [TRT] AveragePool_169 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Average_FastDiv_CAlign4 Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:52:10] [V] [TRT] Tactic: 0xfab3e2ee1c085a9a Time: 0.0271817 [02/13/2023-19:52:10] [V] [TRT] Fastest Tactic: 0xfab3e2ee1c085a9a Time: 0.0271817 [02/13/2023-19:52:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:52:10] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:10] [V] [TRT] *************** Autotuning format combination: Float(442368,147456,512,1) -> Float(147456,147456,512,1) *************** [02/13/2023-19:52:10] [V] [TRT] --------------- Timing Runner: ReduceMean_298 (Reduce) [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0283703 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0267025 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.027379 [02/13/2023-19:52:10] [V] [TRT] Fastest Tactic: 0x0000000000000007 Time: 0.0267025 [02/13/2023-19:52:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000007 [02/13/2023-19:52:10] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:10] [V] [TRT] *************** Autotuning format combination: Float(2174976,36864,256,1) -> Float(986112,9216,128,1) *************** [02/13/2023-19:52:10] [V] [TRT] --------------- Timing Runner: AveragePool_170 (TiledPooling) [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710101 Time: 0.123438 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710102 Time: 0.0666027 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710104 Time: 0.0368971 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710107 Time: 0.0231262 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710108 Time: 0.0202886 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071010f Time: 0.0136291 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710110 Time: 0.0119459 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071011f Time: 0.0112176 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710120 Time: 0.00955764 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710201 Time: 0.0658316 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710202 Time: 0.0356581 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710204 Time: 0.020272 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710207 Time: 0.0137288 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710208 Time: 0.0119676 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071020f Time: 0.00991604 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710210 Time: 0.0095939 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071021f Time: 0.0114694 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710220 Time: 0.00961189 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710301 Time: 0.0444503 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710302 Time: 0.0262408 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710304 Time: 0.0156151 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710307 Time: 0.0113843 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710308 Time: 0.0096451 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071030f Time: 0.0111107 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710310 Time: 0.00978895 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071031f Time: 0.0116065 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710320 Time: 0.00969112 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710401 Time: 0.0351232 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710402 Time: 0.0202749 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710404 Time: 0.0119615 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710407 Time: 0.0110833 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710408 Time: 0.00949886 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071040f Time: 0.0110442 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710410 Time: 0.00956831 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071041f Time: 0.0118309 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710420 Time: 0.0100651 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710501 Time: 0.0304704 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710502 Time: 0.0180891 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710504 Time: 0.0115945 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710507 Time: 0.0116192 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710508 Time: 0.0107037 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071050f Time: 0.0117261 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710510 Time: 0.0112802 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071051f Time: 0.0138323 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710520 Time: 0.0119044 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710601 Time: 0.0246453 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710602 Time: 0.0156009 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710604 Time: 0.00959939 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710607 Time: 0.0113621 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710608 Time: 0.0096832 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071060f Time: 0.0113723 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710610 Time: 0.0096704 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071061f Time: 0.0136021 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710620 Time: 0.0113139 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710701 Time: 0.0237055 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710702 Time: 0.0138901 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710704 Time: 0.0113143 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710707 Time: 0.0117496 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710708 Time: 0.00995657 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071070f Time: 0.0119109 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710710 Time: 0.0114739 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071071f Time: 0.0179337 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710720 Time: 0.0157431 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710801 Time: 0.0182691 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710802 Time: 0.0118597 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710804 Time: 0.00982278 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710807 Time: 0.00991086 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710808 Time: 0.0096512 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071080f Time: 0.0112756 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710810 Time: 0.0103513 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071081f Time: 0.0160051 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710820 Time: 0.0138053 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710901 Time: 0.01834 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710902 Time: 0.011952 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710904 Time: 0.0114152 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710907 Time: 0.00981303 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710908 Time: 0.00975482 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x000000000071090f Time: 0.0121836 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710910 Time: 0.0115225 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710a01 Time: 0.0181811 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710a02 Time: 0.012003 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710a04 Time: 0.0113073 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710a07 Time: 0.0114008 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710a08 Time: 0.0113836 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710a0f Time: 0.0136927 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710a10 Time: 0.0119756 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b01 Time: 0.0167436 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b02 Time: 0.0113593 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b04 Time: 0.0113048 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b07 Time: 0.0115664 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b08 Time: 0.0111768 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b0f Time: 0.013472 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710b10 Time: 0.0116976 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c01 Time: 0.0156864 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c02 Time: 0.00976183 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c04 Time: 0.00967985 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c07 Time: 0.0112004 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c08 Time: 0.00969539 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c0f Time: 0.0119634 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000710c10 Time: 0.0113196 [02/13/2023-19:52:10] [V] [TRT] Fastest Tactic: 0x0000000000710408 Time: 0.00949886 [02/13/2023-19:52:10] [V] [TRT] --------------- Timing Runner: AveragePool_170 (CudnnPooling) [02/13/2023-19:52:10] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00739314 [02/13/2023-19:52:10] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00739314 [02/13/2023-19:52:10] [V] [TRT] --------------- Timing Runner: AveragePool_170 (CaskPooling) [02/13/2023-19:52:10] [V] [TRT] AveragePool_170 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Average_FastDiv Tactic: 0x933eceba7b866d59 [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x933eceba7b866d59 Time: 0.0074528 [02/13/2023-19:52:10] [V] [TRT] Fastest Tactic: 0x933eceba7b866d59 Time: 0.0074528 [02/13/2023-19:52:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: 0xffffffffffffffff [02/13/2023-19:52:10] [V] [TRT] *************** Autotuning format combination: Float(552960,1:4,3840,15) -> Float(248832,1:4,3456,27) *************** [02/13/2023-19:52:10] [V] [TRT] --------------- Timing Runner: AveragePool_170 (CaskPooling) [02/13/2023-19:52:10] [V] [TRT] AveragePool_170 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Average_FastDiv_CAlign4 Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:52:10] [V] [TRT] Tactic: 0xfab3e2ee1c085a9a Time: 0.0202006 [02/13/2023-19:52:10] [V] [TRT] Fastest Tactic: 0xfab3e2ee1c085a9a Time: 0.0202006 [02/13/2023-19:52:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:52:10] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:10] [V] [TRT] *************** Autotuning format combination: Float(442368,147456,512,1), Float(3,1,1,1), Float(3,1,1,1) -> Float(442368,147456,512,1) *************** [02/13/2023-19:52:10] [V] [TRT] --------------- Timing Runner: PWN(Sub_5, Div_7) (PointWiseV2) [02/13/2023-19:52:10] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0386251 [02/13/2023-19:52:11] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0283215 [02/13/2023-19:52:11] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0277829 [02/13/2023-19:52:11] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0234397 [02/13/2023-19:52:12] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0231014 [02/13/2023-19:52:12] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0235598 [02/13/2023-19:52:12] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0198526 [02/13/2023-19:52:13] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.019276 [02/13/2023-19:52:13] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0218416 [02/13/2023-19:52:13] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0212376 [02/13/2023-19:52:14] [V] [TRT] Tactic: 0x000000000000001c Time: 0.03688 [02/13/2023-19:52:14] [V] [TRT] Fastest Tactic: 0x0000000000000007 Time: 0.019276 [02/13/2023-19:52:14] [V] [TRT] --------------- Timing Runner: PWN(Sub_5, Div_7) (PointWise) [02/13/2023-19:52:14] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:52:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000007 [02/13/2023-19:52:14] [V] [TRT] *************** Autotuning format combination: Float(442368,1,1536,3), Float(3,1,3,3), Float(3,1,3,3) -> Float(442368,1,1536,3) *************** [02/13/2023-19:52:14] [V] [TRT] --------------- Timing Runner: PWN(Sub_5, Div_7) (PointWiseV2) [02/13/2023-19:52:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.415342 [02/13/2023-19:52:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.499026 [02/13/2023-19:52:14] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.460096 [02/13/2023-19:52:15] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.57701 [02/13/2023-19:52:15] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.629659 [02/13/2023-19:52:15] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.546775 [02/13/2023-19:52:16] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.729577 [02/13/2023-19:52:16] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.770619 [02/13/2023-19:52:16] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.780731 [02/13/2023-19:52:17] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.719026 [02/13/2023-19:52:17] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0427063 [02/13/2023-19:52:17] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0427063 [02/13/2023-19:52:17] [V] [TRT] --------------- Timing Runner: PWN(Sub_5, Div_7) (PointWise) [02/13/2023-19:52:17] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:52:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:52:17] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,512,1), Float(1,1:4,1,1), Float(1,1:4,1,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:52:17] [V] [TRT] --------------- Timing Runner: PWN(Sub_5, Div_7) (PointWiseV2) [02/13/2023-19:52:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.803365 [02/13/2023-19:52:18] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.920905 [02/13/2023-19:52:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.86219 [02/13/2023-19:52:18] [V] [TRT] Tactic: 0x0000000000000003 Time: 1.05819 [02/13/2023-19:52:19] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.19373 [02/13/2023-19:52:19] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.983685 [02/13/2023-19:52:19] [V] [TRT] Tactic: 0x0000000000000006 Time: 1.3171 [02/13/2023-19:52:20] [V] [TRT] Tactic: 0x0000000000000007 Time: 1.44396 [02/13/2023-19:52:20] [V] [TRT] Tactic: 0x0000000000000008 Time: 1.61247 [02/13/2023-19:52:21] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.73239 [02/13/2023-19:52:21] [V] [TRT] Tactic: 0x000000000000000a Time: 0.598999 [02/13/2023-19:52:21] [V] [TRT] Tactic: 0x000000000000000b Time: 0.684823 [02/13/2023-19:52:22] [V] [TRT] Tactic: 0x000000000000000c Time: 0.6192 [02/13/2023-19:52:22] [V] [TRT] Tactic: 0x000000000000000d Time: 0.784251 [02/13/2023-19:52:22] [V] [TRT] Tactic: 0x000000000000000e Time: 0.888462 [02/13/2023-19:52:23] [V] [TRT] Tactic: 0x000000000000000f Time: 0.650437 [02/13/2023-19:52:23] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.981495 [02/13/2023-19:52:23] [V] [TRT] Tactic: 0x0000000000000011 Time: 1.09397 [02/13/2023-19:52:24] [V] [TRT] Tactic: 0x0000000000000012 Time: 1.12452 [02/13/2023-19:52:24] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.829659 [02/13/2023-19:52:25] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.478569 [02/13/2023-19:52:25] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.569486 [02/13/2023-19:52:25] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.671849 [02/13/2023-19:52:26] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.92587 [02/13/2023-19:52:26] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0781211 [02/13/2023-19:52:26] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0582811 [02/13/2023-19:52:26] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0904526 [02/13/2023-19:52:26] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.0582811 [02/13/2023-19:52:26] [V] [TRT] --------------- Timing Runner: PWN(Sub_5, Div_7) (PointWise) [02/13/2023-19:52:26] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:52:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [02/13/2023-19:52:26] [V] [TRT] *************** Autotuning format combination: Float(147456,147456:32,512,1), Float(1,1:32,1,1), Float(1,1:32,1,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:52:26] [V] [TRT] --------------- Timing Runner: PWN(Sub_5, Div_7) (PointWiseV2) [02/13/2023-19:52:27] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.648274 [02/13/2023-19:52:27] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.600581 [02/13/2023-19:52:28] [V] [TRT] Tactic: 0x000000000000001a Time: 0.620128 [02/13/2023-19:52:28] [V] [TRT] Tactic: 0x000000000000001b Time: 0.585879 [02/13/2023-19:52:28] [V] [TRT] Tactic: 0x000000000000001f Time: 0.651031 [02/13/2023-19:52:28] [V] [TRT] Fastest Tactic: 0x000000000000001b Time: 0.585879 [02/13/2023-19:52:28] [V] [TRT] --------------- Timing Runner: PWN(Sub_5, Div_7) (PointWise) [02/13/2023-19:52:28] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:52:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001b [02/13/2023-19:52:28] [V] [TRT] *************** Autotuning format combination: Float(1:4,147456,512,1), Float(1:4,1,1,1), Float(1:4,1,1,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:52:28] [V] [TRT] --------------- Timing Runner: PWN(Sub_5, Div_7) (PointWiseV2) [02/13/2023-19:52:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 4.33413 [02/13/2023-19:52:28] [V] [TRT] Tactic: 0x0000000000000001 Time: 4.98279 [02/13/2023-19:52:28] [V] [TRT] Tactic: 0x0000000000000002 Time: 4.21061 [02/13/2023-19:52:28] [V] [TRT] Tactic: 0x0000000000000003 Time: 5.02656 [02/13/2023-19:52:28] [V] [TRT] Tactic: 0x0000000000000004 Time: 3.59106 [02/13/2023-19:52:28] [V] [TRT] Tactic: 0x0000000000000005 Time: 2.96804 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000000006 Time: 3.94436 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000000007 Time: 4.32085 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000000008 Time: 4.8437 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000000009 Time: 5.31766 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000000000a Time: 1.78693 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000000000b Time: 2.04294 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000000000c Time: 1.84631 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000000000d Time: 2.33762 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000000000e Time: 2.6591 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000000000f Time: 1.94559 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000000010 Time: 2.94054 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000000011 Time: 3.27577 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000000012 Time: 3.41111 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000000013 Time: 2.51314 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000000014 Time: 1.43014 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000000015 Time: 1.69945 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000000016 Time: 2.00795 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000000017 Time: 2.64178 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000000001c Time: 0.152197 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000000001d Time: 0.122206 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000000001e Time: 0.183648 [02/13/2023-19:52:29] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.122206 [02/13/2023-19:52:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [02/13/2023-19:52:29] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:29] [V] [TRT] *************** Autotuning format combination: Float(986112,9216,128,1) -> Float(393984,2304,64,1) *************** [02/13/2023-19:52:29] [V] [TRT] --------------- Timing Runner: AveragePool_171 (TiledPooling) [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710101 Time: 0.0348544 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710102 Time: 0.0199983 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710104 Time: 0.0120248 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710107 Time: 0.00959177 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710108 Time: 0.00871906 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071010f Time: 0.00717189 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710110 Time: 0.00687869 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071011f Time: 0.00640278 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710120 Time: 0.00639662 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710201 Time: 0.0200297 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710202 Time: 0.0118639 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710204 Time: 0.00888282 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710207 Time: 0.00706133 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710208 Time: 0.00686563 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071020f Time: 0.00632089 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710210 Time: 0.00591488 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071021f Time: 0.00678566 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710220 Time: 0.00576969 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710301 Time: 0.0154505 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710302 Time: 0.00967436 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710304 Time: 0.0070535 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710307 Time: 0.00636542 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710308 Time: 0.00553213 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071030f Time: 0.00626147 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710310 Time: 0.00578542 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071031f Time: 0.00673995 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710320 Time: 0.00566277 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710401 Time: 0.0120164 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710402 Time: 0.00886104 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710404 Time: 0.00681491 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710407 Time: 0.00630957 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710408 Time: 0.00573403 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071040f Time: 0.00622231 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710410 Time: 0.0058123 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071041f Time: 0.00685453 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710420 Time: 0.00592914 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710501 Time: 0.0114518 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710502 Time: 0.0076468 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710504 Time: 0.00656603 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710507 Time: 0.0067067 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710508 Time: 0.00602419 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071050f Time: 0.0066587 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710510 Time: 0.00653403 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071051f Time: 0.00743657 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710520 Time: 0.00663938 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710601 Time: 0.00969173 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710602 Time: 0.00707527 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710604 Time: 0.00562497 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710607 Time: 0.0062021 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710608 Time: 0.00589787 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071060f Time: 0.00636979 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710610 Time: 0.00559262 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071061f Time: 0.00712729 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710620 Time: 0.00659906 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710701 Time: 0.00966766 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710702 Time: 0.00710901 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710704 Time: 0.0062398 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710707 Time: 0.00673475 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710708 Time: 0.00606152 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071070f Time: 0.00675886 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710710 Time: 0.00652468 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071071f Time: 0.00918086 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710720 Time: 0.0074928 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710801 Time: 0.00897686 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710802 Time: 0.00669299 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710804 Time: 0.0058869 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710807 Time: 0.00636701 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710808 Time: 0.00602667 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071080f Time: 0.00660904 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710810 Time: 0.00588526 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071081f Time: 0.00759218 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710820 Time: 0.00675408 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710901 Time: 0.00766075 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710902 Time: 0.00660447 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710904 Time: 0.00608095 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710907 Time: 0.00601848 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710908 Time: 0.00612076 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x000000000071090f Time: 0.00661236 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710910 Time: 0.00638748 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710a01 Time: 0.00755368 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710a02 Time: 0.00657143 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710a04 Time: 0.00611105 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710a07 Time: 0.00648626 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710a08 Time: 0.00636561 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710a0f Time: 0.00675907 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710a10 Time: 0.00665039 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710b01 Time: 0.00759074 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710b02 Time: 0.0065226 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710b04 Time: 0.00661548 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710b07 Time: 0.00661444 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710b08 Time: 0.00618057 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710b0f Time: 0.0068911 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710b10 Time: 0.00660717 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710c01 Time: 0.0070929 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710c02 Time: 0.00569758 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710c04 Time: 0.00584777 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710c07 Time: 0.00624616 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710c08 Time: 0.00556993 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710c0f Time: 0.00667304 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x0000000000710c10 Time: 0.00655958 [02/13/2023-19:52:29] [V] [TRT] Fastest Tactic: 0x0000000000710308 Time: 0.00553213 [02/13/2023-19:52:29] [V] [TRT] --------------- Timing Runner: AveragePool_171 (CudnnPooling) [02/13/2023-19:52:29] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00582071 [02/13/2023-19:52:29] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00582071 [02/13/2023-19:52:29] [V] [TRT] --------------- Timing Runner: AveragePool_171 (CaskPooling) [02/13/2023-19:52:29] [V] [TRT] AveragePool_171 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Average_FastDiv Tactic: 0x933eceba7b866d59 [02/13/2023-19:52:29] [V] [TRT] Tactic: 0x933eceba7b866d59 Time: 0.00566295 [02/13/2023-19:52:29] [V] [TRT] Fastest Tactic: 0x933eceba7b866d59 Time: 0.00566295 [02/13/2023-19:52:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 0x0000000000710308 [02/13/2023-19:52:29] [V] [TRT] *************** Autotuning format combination: Float(248832,1:4,3456,27) -> Float(99072,1:4,2752,43) *************** [02/13/2023-19:52:29] [V] [TRT] --------------- Timing Runner: AveragePool_171 (CaskPooling) [02/13/2023-19:52:29] [V] [TRT] AveragePool_171 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Average_FastDiv_CAlign4 Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:52:29] [V] [TRT] Tactic: 0xfab3e2ee1c085a9a Time: 0.00650535 [02/13/2023-19:52:29] [V] [TRT] Fastest Tactic: 0xfab3e2ee1c085a9a Time: 0.00650535 [02/13/2023-19:52:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:52:29] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:29] [V] [TRT] *************** Autotuning format combination: Float(589824,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:52:29] [V] [TRT] --------------- Timing Runner: Conv_301 (CudaDepthwiseConvolution) [02/13/2023-19:52:29] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.386496 [02/13/2023-19:52:29] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.386496 [02/13/2023-19:52:30] [V] [TRT] --------------- Timing Runner: Conv_301 (CudnnConvolution) [02/13/2023-19:52:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0826949 [02/13/2023-19:52:30] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0821029 [02/13/2023-19:52:30] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0791589 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x0000000000000005 Time: 8.58306 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x0000000000000006 Time: 1.13183 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0820686 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0841349 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0812274 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x000000000000003d Time: 8.60945 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x000000000000003e Time: 1.14167 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0810309 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0813806 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.07824 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x0000000000000075 Time: 8.614 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x0000000000000076 Time: 1.13893 [02/13/2023-19:52:31] [V] [TRT] Fastest Tactic: 0x0000000000000072 Time: 0.07824 [02/13/2023-19:52:31] [V] [TRT] --------------- Timing Runner: Conv_301 (CaskConvolution) [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 3.12437 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 1.72365 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.932119 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x4727434768e46395 Time: 1.53257 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 2.87861 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 1.99638 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 2.88503 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 3.20396 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 1.11149 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 1.13741 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:52:31] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 1.58802 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.466043 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 2.96174 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 1.82203 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:52:31] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 2.0162 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.959771 [02/13/2023-19:52:31] [V] [TRT] Fastest Tactic: 0xa8609adc4e0ceb90 Time: 0.466043 [02/13/2023-19:52:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000072 [02/13/2023-19:52:31] [V] [TRT] *************** Autotuning format combination: Float(589824,1,2048,4) -> Float(589824,1,2048,4) *************** [02/13/2023-19:52:31] [V] [TRT] --------------- Timing Runner: Conv_301 (CaskConvolution) [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 2.77954 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 2.43049 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 10.7888 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf2 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x5030121339a48bf2 Time: 3.81385 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 2.59223 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:52:31] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 2.54685 [02/13/2023-19:52:31] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 2.50041 [02/13/2023-19:52:32] [V] [TRT] Conv_301 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d739 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xca7eeb8d9143d739 Time: 3.88138 [02/13/2023-19:52:32] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 4.64765 [02/13/2023-19:52:32] [V] [TRT] Conv_301 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf50 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xd9031472c05adf50 Time: 3.82624 [02/13/2023-19:52:32] [V] [TRT] Conv_301 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 2.40651 [02/13/2023-19:52:32] [V] [TRT] Fastest Tactic: 0xf48db81f02eca9ee Time: 2.40651 [02/13/2023-19:52:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf48db81f02eca9ee [02/13/2023-19:52:32] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:52:32] [V] [TRT] --------------- Timing Runner: Conv_301 (CaskConvolution) [02/13/2023-19:52:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:52:32] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:32] [V] [TRT] *************** Autotuning format combination: Float(589824,147456,512,1), Float(589824,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:52:32] [V] [TRT] --------------- Timing Runner: Mul_307 (ElementWise) [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0324288 [02/13/2023-19:52:32] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0324288 [02/13/2023-19:52:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:52:32] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,512,1), Float(147456,1:4,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:52:32] [V] [TRT] --------------- Timing Runner: Mul_307 (ElementWise) [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0332882 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0514575 [02/13/2023-19:52:32] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0332882 [02/13/2023-19:52:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:52:32] [V] [TRT] *************** Autotuning format combination: Float(147456,147456:32,512,1), Float(147456,147456:32,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:52:32] [V] [TRT] --------------- Timing Runner: Mul_307 (ElementWise) [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.233161 [02/13/2023-19:52:32] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.233161 [02/13/2023-19:52:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:52:32] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:32] [V] [TRT] *************** Autotuning format combination: Float(442368,147456,512,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:52:32] [V] [TRT] --------------- Timing Runner: Conv_8 (CudaDepthwiseConvolution) [02/13/2023-19:52:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:52:32] [V] [TRT] --------------- Timing Runner: Conv_8 (FusedConvActConvolution) [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x000000000006ffff Time: 0.139303 [02/13/2023-19:52:32] [V] [TRT] Fastest Tactic: 0x000000000006ffff Time: 0.139303 [02/13/2023-19:52:32] [V] [TRT] --------------- Timing Runner: Conv_8 (CudnnConvolution) [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0856206 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.080848 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.130642 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000005 Time: 2.83041 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0838377 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0844114 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x000000000000003a Time: 0.131513 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x000000000000003d Time: 2.71952 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0848526 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0816777 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.130558 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x0000000000000075 Time: 2.72887 [02/13/2023-19:52:32] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.080848 [02/13/2023-19:52:32] [V] [TRT] --------------- Timing Runner: Conv_8 (CaskConvolution) [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 0.248549 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 0.139938 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.08896 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x4727434768e46395 Time: 0.130734 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 0.232416 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.17323 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 0.242857 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 0.254034 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 0.101925 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 0.131931 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0580023 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 0.246551 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 0.158551 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.17355 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0917646 [02/13/2023-19:52:32] [V] [TRT] Fastest Tactic: 0xa8609adc4e0ceb90 Time: 0.0580023 [02/13/2023-19:52:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:52:32] [V] [TRT] *************** Autotuning format combination: Float(442368,1,1536,3) -> Float(589824,1,4096,16) *************** [02/13/2023-19:52:32] [V] [TRT] --------------- Timing Runner: Conv_8 (CaskConvolution) [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.178203 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.0541501 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.160114 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.0417029 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 0.705509 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.0255756 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.246222 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.0308745 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.16784 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.0340599 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.179328 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.162007 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.0256404 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.250962 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.0277356 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.294153 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.248041 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.0305874 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.157897 [02/13/2023-19:52:32] [V] [TRT] Fastest Tactic: 0x43ffe5cf09cee087 Time: 0.0255756 [02/13/2023-19:52:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:52:32] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,512,1) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:52:32] [V] [TRT] --------------- Timing Runner: Conv_8 (CaskConvolution) [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.0273486 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.367785 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.199269 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.178217 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.0289051 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.0552549 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.156914 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.208018 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.039536 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.250766 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.26533 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.360457 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.240302 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.39648 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.0417611 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.277847 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.276809 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 0.705906 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.0372091 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.0329957 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.268334 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.039696 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.0331721 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.397824 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.24544 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.0506499 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.394025 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.167387 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x634e99502974e4da Time: 0.242729 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.145806 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.345637 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.193358 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.292914 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.309079 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.0387074 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.186309 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.238162 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.0389406 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.043936 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.182917 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.384603 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.0558796 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.0536655 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.162629 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.0310245 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.409915 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.13517 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.0324078 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.145838 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.0359554 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.0337691 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.0420526 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.0424514 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.140624 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.302144 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.0427646 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.155154 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 0.267072 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.296347 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.250976 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.0318747 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.152974 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.0420171 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.295717 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.325952 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.341339 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.250779 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.2464 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.0384811 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.219168 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.0404286 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.285682 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.0442 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.34011 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.158505 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.0372674 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.240814 [02/13/2023-19:52:32] [V] [TRT] Conv_8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:52:32] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.0365726 [02/13/2023-19:52:32] [V] [TRT] Fastest Tactic: 0x10383a0781d24dde Time: 0.0273486 [02/13/2023-19:52:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x10383a0781d24dde [02/13/2023-19:52:32] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:32] [V] [TRT] *************** Autotuning format combination: Float(589824,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:52:32] [V] [TRT] *************** Autotuning format combination: Float(589824,1,2048,4) -> Float(589824,1,2048,4) *************** [02/13/2023-19:52:32] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:52:32] [V] [TRT] --------------- Timing Runner: Conv_308 (CaskConvolution) [02/13/2023-19:52:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:52:32] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:32] [V] [TRT] *************** Autotuning format combination: Float(589824,147456,512,1), Float(589824,147456,512,1) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:52:32] [V] [TRT] --------------- Timing Runner: PWN(Mul_309, Sub_310) (PointWiseV2) [02/13/2023-19:52:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0468217 [02/13/2023-19:52:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0438537 [02/13/2023-19:52:33] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0446914 [02/13/2023-19:52:34] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0435314 [02/13/2023-19:52:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0438469 [02/13/2023-19:52:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.043528 [02/13/2023-19:52:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0443017 [02/13/2023-19:52:35] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0434857 [02/13/2023-19:52:35] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0433954 [02/13/2023-19:52:35] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0434526 [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0468023 [02/13/2023-19:52:36] [V] [TRT] Fastest Tactic: 0x0000000000000008 Time: 0.0433954 [02/13/2023-19:52:36] [V] [TRT] --------------- Timing Runner: PWN(Mul_309, Sub_310) (PointWise) [02/13/2023-19:52:36] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:52:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000008 [02/13/2023-19:52:36] [V] [TRT] *************** Autotuning format combination: Float(589824,1,2048,4), Float(589824,1,2048,4) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:52:36] [V] [TRT] --------------- Timing Runner: PWN(Mul_309, Sub_310) (PointWiseV2) [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.291835 [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.322043 [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.304983 [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.367968 [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.389993 [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.327291 [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.477266 [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.487831 [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.475515 [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.422789 [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0957189 [02/13/2023-19:52:36] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0957189 [02/13/2023-19:52:36] [V] [TRT] --------------- Timing Runner: PWN(Mul_309, Sub_310) (PointWise) [02/13/2023-19:52:36] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:52:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:52:36] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,512,1), Float(147456,1:4,512,1) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:52:36] [V] [TRT] --------------- Timing Runner: PWN(Mul_309, Sub_310) (PointWiseV2) [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.384306 [02/13/2023-19:52:36] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.415401 [02/13/2023-19:52:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.434318 [02/13/2023-19:52:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.497486 [02/13/2023-19:52:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.564974 [02/13/2023-19:52:38] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.433207 [02/13/2023-19:52:38] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.674194 [02/13/2023-19:52:38] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.735726 [02/13/2023-19:52:39] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.848265 [02/13/2023-19:52:39] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.710432 [02/13/2023-19:52:39] [V] [TRT] Tactic: 0x000000000000000a Time: 0.324745 [02/13/2023-19:52:40] [V] [TRT] Tactic: 0x000000000000000b Time: 0.385687 [02/13/2023-19:52:40] [V] [TRT] Tactic: 0x000000000000000c Time: 0.340155 [02/13/2023-19:52:40] [V] [TRT] Tactic: 0x000000000000000d Time: 0.480759 [02/13/2023-19:52:41] [V] [TRT] Tactic: 0x000000000000000e Time: 0.471634 [02/13/2023-19:52:41] [V] [TRT] Tactic: 0x000000000000000f Time: 0.351063 [02/13/2023-19:52:41] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.684997 [02/13/2023-19:52:41] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.601472 [02/13/2023-19:52:42] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.644855 [02/13/2023-19:52:42] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.414053 [02/13/2023-19:52:42] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.298112 [02/13/2023-19:52:43] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.348434 [02/13/2023-19:52:43] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.419621 [02/13/2023-19:52:43] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.582601 [02/13/2023-19:52:44] [V] [TRT] Tactic: 0x000000000000001c Time: 0.117413 [02/13/2023-19:52:44] [V] [TRT] Tactic: 0x000000000000001d Time: 0.105717 [02/13/2023-19:52:44] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0970583 [02/13/2023-19:52:44] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.0970583 [02/13/2023-19:52:44] [V] [TRT] --------------- Timing Runner: PWN(Mul_309, Sub_310) (PointWise) [02/13/2023-19:52:44] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:52:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [02/13/2023-19:52:44] [V] [TRT] *************** Autotuning format combination: Float(147456,147456:32,512,1), Float(147456,147456:32,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:52:44] [V] [TRT] --------------- Timing Runner: PWN(Mul_309, Sub_310) (PointWiseV2) [02/13/2023-19:52:45] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.381239 [02/13/2023-19:52:45] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.377426 [02/13/2023-19:52:45] [V] [TRT] Tactic: 0x000000000000001a Time: 0.376699 [02/13/2023-19:52:46] [V] [TRT] Tactic: 0x000000000000001b Time: 0.376969 [02/13/2023-19:52:46] [V] [TRT] Tactic: 0x000000000000001f Time: 0.382569 [02/13/2023-19:52:46] [V] [TRT] Fastest Tactic: 0x000000000000001a Time: 0.376699 [02/13/2023-19:52:46] [V] [TRT] --------------- Timing Runner: PWN(Mul_309, Sub_310) (PointWise) [02/13/2023-19:52:46] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:52:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001a [02/13/2023-19:52:46] [V] [TRT] *************** Autotuning format combination: Float(1:4,147456,512,1), Float(1:4,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:52:46] [V] [TRT] --------------- Timing Runner: PWN(Mul_309, Sub_310) (PointWiseV2) [02/13/2023-19:52:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.43014 [02/13/2023-19:52:46] [V] [TRT] Tactic: 0x0000000000000001 Time: 1.67824 [02/13/2023-19:52:47] [V] [TRT] Tactic: 0x0000000000000002 Time: 1.68016 [02/13/2023-19:52:47] [V] [TRT] Tactic: 0x0000000000000003 Time: 2.26716 [02/13/2023-19:52:48] [V] [TRT] Tactic: 0x0000000000000004 Time: 2.32995 [02/13/2023-19:52:48] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.70308 [02/13/2023-19:52:48] [V] [TRT] Tactic: 0x0000000000000006 Time: 3.44616 [02/13/2023-19:52:49] [V] [TRT] Tactic: 0x0000000000000007 Time: 3.06074 [02/13/2023-19:52:49] [V] [TRT] Tactic: 0x0000000000000008 Time: 3.50696 [02/13/2023-19:52:49] [V] [TRT] Tactic: 0x0000000000000009 Time: 3.11287 [02/13/2023-19:52:50] [V] [TRT] Tactic: 0x000000000000000a Time: 1.21961 [02/13/2023-19:52:50] [V] [TRT] Tactic: 0x000000000000000b Time: 1.59655 [02/13/2023-19:52:50] [V] [TRT] Tactic: 0x000000000000000c Time: 1.44743 [02/13/2023-19:52:51] [V] [TRT] Tactic: 0x000000000000000d Time: 2.18347 [02/13/2023-19:52:51] [V] [TRT] Tactic: 0x000000000000000e Time: 2.11069 [02/13/2023-19:52:51] [V] [TRT] Tactic: 0x000000000000000f Time: 1.49089 [02/13/2023-19:52:52] [V] [TRT] Tactic: 0x0000000000000010 Time: 3.45274 [02/13/2023-19:52:52] [V] [TRT] Tactic: 0x0000000000000011 Time: 2.93682 [02/13/2023-19:52:52] [V] [TRT] Tactic: 0x0000000000000012 Time: 2.98781 [02/13/2023-19:52:53] [V] [TRT] Tactic: 0x0000000000000013 Time: 1.93062 [02/13/2023-19:52:53] [V] [TRT] Tactic: 0x0000000000000014 Time: 1.10104 [02/13/2023-19:52:54] [V] [TRT] Tactic: 0x0000000000000015 Time: 1.45211 [02/13/2023-19:52:54] [V] [TRT] Tactic: 0x0000000000000016 Time: 1.89225 [02/13/2023-19:52:54] [V] [TRT] Tactic: 0x0000000000000017 Time: 2.80164 [02/13/2023-19:52:54] [V] [TRT] Tactic: 0x000000000000001c Time: 0.196009 [02/13/2023-19:52:55] [V] [TRT] Tactic: 0x000000000000001d Time: 0.202853 [02/13/2023-19:52:55] [V] [TRT] Tactic: 0x000000000000001e Time: 0.184087 [02/13/2023-19:52:55] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.184087 [02/13/2023-19:52:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [02/13/2023-19:52:55] [V] [TRT] =============== Computing costs for [02/13/2023-19:52:55] [V] [TRT] *************** Autotuning format combination: Float(589824,36864,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:52:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_9), Mul_10) (PointWiseV2) [02/13/2023-19:52:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0338469 [02/13/2023-19:52:56] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0225548 [02/13/2023-19:52:56] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0214563 [02/13/2023-19:52:56] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0285661 [02/13/2023-19:52:57] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0270027 [02/13/2023-19:52:57] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.025312 [02/13/2023-19:52:57] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0274522 [02/13/2023-19:52:57] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.025792 [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.025341 [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0222015 [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0319424 [02/13/2023-19:52:58] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.0214563 [02/13/2023-19:52:58] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_9), Mul_10) (PointWise) [02/13/2023-19:52:58] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:52:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [02/13/2023-19:52:58] [V] [TRT] *************** Autotuning format combination: Float(589824,1,4096,16) -> Float(589824,1,4096,16) *************** [02/13/2023-19:52:58] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_9), Mul_10) (PointWiseV2) [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0317394 [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0234599 [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0266507 [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0309851 [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0257585 [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.02275 [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0302565 [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0254202 [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0255185 [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0255185 [02/13/2023-19:52:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0350117 [02/13/2023-19:52:58] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.02275 [02/13/2023-19:52:58] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_9), Mul_10) (PointWise) [02/13/2023-19:52:58] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:52:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:52:58] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,1024,4) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:52:58] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_9), Mul_10) (PointWiseV2) [02/13/2023-19:52:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.024589 [02/13/2023-19:52:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0237949 [02/13/2023-19:52:59] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0244968 [02/13/2023-19:52:59] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0242324 [02/13/2023-19:53:00] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0242225 [02/13/2023-19:53:00] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0245821 [02/13/2023-19:53:00] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0208496 [02/13/2023-19:53:01] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0215987 [02/13/2023-19:53:01] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0274423 [02/13/2023-19:53:01] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0256777 [02/13/2023-19:53:02] [V] [TRT] Tactic: 0x000000000000000a Time: 0.025485 [02/13/2023-19:53:02] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0242499 [02/13/2023-19:53:02] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0250674 [02/13/2023-19:53:03] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0251139 [02/13/2023-19:53:03] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0224392 [02/13/2023-19:53:03] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0237355 [02/13/2023-19:53:04] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0253943 [02/13/2023-19:53:04] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0246705 [02/13/2023-19:53:04] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0244724 [02/13/2023-19:53:05] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0226697 [02/13/2023-19:53:05] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0292462 [02/13/2023-19:53:05] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.029483 [02/13/2023-19:53:05] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0287525 [02/13/2023-19:53:06] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0275048 [02/13/2023-19:53:06] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0237087 [02/13/2023-19:53:06] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0258385 [02/13/2023-19:53:07] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0330158 [02/13/2023-19:53:07] [V] [TRT] Fastest Tactic: 0x0000000000000006 Time: 0.0208496 [02/13/2023-19:53:07] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_9), Mul_10) (PointWise) [02/13/2023-19:53:07] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:53:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000006 [02/13/2023-19:53:07] [V] [TRT] *************** Autotuning format combination: Float(36864,36864:32,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:53:07] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_9), Mul_10) (PointWiseV2) [02/13/2023-19:53:07] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0560823 [02/13/2023-19:53:07] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.056957 [02/13/2023-19:53:07] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0583482 [02/13/2023-19:53:08] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0589272 [02/13/2023-19:53:08] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0560518 [02/13/2023-19:53:08] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0560518 [02/13/2023-19:53:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_9), Mul_10) (PointWise) [02/13/2023-19:53:08] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:53:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [02/13/2023-19:53:08] [V] [TRT] *************** Autotuning format combination: Float(1:4,36864,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:53:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_9), Mul_10) (PointWiseV2) [02/13/2023-19:53:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.12638 [02/13/2023-19:53:09] [V] [TRT] Tactic: 0x0000000000000001 Time: 1.43163 [02/13/2023-19:53:09] [V] [TRT] Tactic: 0x0000000000000002 Time: 1.39647 [02/13/2023-19:53:09] [V] [TRT] Tactic: 0x0000000000000003 Time: 2.00151 [02/13/2023-19:53:10] [V] [TRT] Tactic: 0x0000000000000004 Time: 2.6021 [02/13/2023-19:53:10] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.89017 [02/13/2023-19:53:10] [V] [TRT] Tactic: 0x0000000000000006 Time: 5.03836 [02/13/2023-19:53:11] [V] [TRT] Tactic: 0x0000000000000007 Time: 3.76697 [02/13/2023-19:53:11] [V] [TRT] Tactic: 0x0000000000000008 Time: 3.13386 [02/13/2023-19:53:12] [V] [TRT] Tactic: 0x0000000000000009 Time: 3.28069 [02/13/2023-19:53:12] [V] [TRT] Tactic: 0x000000000000000a Time: 1.72242 [02/13/2023-19:53:12] [V] [TRT] Tactic: 0x000000000000000b Time: 2.55035 [02/13/2023-19:53:13] [V] [TRT] Tactic: 0x000000000000000c Time: 2.20814 [02/13/2023-19:53:13] [V] [TRT] Tactic: 0x000000000000000d Time: 3.07883 [02/13/2023-19:53:13] [V] [TRT] Tactic: 0x000000000000000e Time: 2.95403 [02/13/2023-19:53:14] [V] [TRT] Tactic: 0x000000000000000f Time: 2.18225 [02/13/2023-19:53:14] [V] [TRT] Tactic: 0x0000000000000010 Time: 4.49885 [02/13/2023-19:53:14] [V] [TRT] Tactic: 0x0000000000000011 Time: 3.83104 [02/13/2023-19:53:15] [V] [TRT] Tactic: 0x0000000000000012 Time: 3.14928 [02/13/2023-19:53:15] [V] [TRT] Tactic: 0x0000000000000013 Time: 2.67846 [02/13/2023-19:53:15] [V] [TRT] Tactic: 0x0000000000000014 Time: 1.76097 [02/13/2023-19:53:16] [V] [TRT] Tactic: 0x0000000000000015 Time: 2.30275 [02/13/2023-19:53:16] [V] [TRT] Tactic: 0x0000000000000016 Time: 3.51103 [02/13/2023-19:53:16] [V] [TRT] Tactic: 0x0000000000000017 Time: 5.2259 [02/13/2023-19:53:17] [V] [TRT] Tactic: 0x000000000000001c Time: 0.184393 [02/13/2023-19:53:17] [V] [TRT] Tactic: 0x000000000000001d Time: 0.19445 [02/13/2023-19:53:17] [V] [TRT] Tactic: 0x000000000000001e Time: 0.310053 [02/13/2023-19:53:17] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.184393 [02/13/2023-19:53:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:53:17] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:17] [V] [TRT] *************** Autotuning format combination: Float(589824,36864,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:53:17] [V] [TRT] --------------- Timing Runner: Conv_11 + Relu_12 (CudaDepthwiseConvolution) [02/13/2023-19:53:17] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.261298 [02/13/2023-19:53:17] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.261298 [02/13/2023-19:53:17] [V] [TRT] --------------- Timing Runner: Conv_11 + Relu_12 (CudnnConvolution) [02/13/2023-19:53:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.277975 [02/13/2023-19:53:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.276224 [02/13/2023-19:53:17] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.279543 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x0000000000000005 Time: 24.3602 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x0000000000000006 Time: 2.33007 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.213358 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.214414 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x000000000000003a Time: 0.197472 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x000000000000003d Time: 14.1123 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x000000000000003e Time: 1.20116 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.121349 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.117659 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.123819 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x0000000000000075 Time: 11.598 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x0000000000000076 Time: 1.19749 [02/13/2023-19:53:18] [V] [TRT] Fastest Tactic: 0x0000000000000071 Time: 0.117659 [02/13/2023-19:53:18] [V] [TRT] --------------- Timing Runner: Conv_11 + Relu_12 (CaskConvolution) [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 3.18873 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 1.78581 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 1.05011 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x4727434768e46395 Time: 1.58902 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 2.94447 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 2.06981 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 2.9163 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 3.29972 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 1.20465 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 1.20564 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:53:18] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 1.64932 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.594272 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 3.02208 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 1.87118 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:53:18] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 2.07125 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 1.07253 [02/13/2023-19:53:18] [V] [TRT] Fastest Tactic: 0xa8609adc4e0ceb90 Time: 0.594272 [02/13/2023-19:53:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000071 [02/13/2023-19:53:18] [V] [TRT] *************** Autotuning format combination: Float(589824,1,4096,16) -> Float(589824,1,4096,16) *************** [02/13/2023-19:53:18] [V] [TRT] --------------- Timing Runner: Conv_11 + Relu_12 (CaskConvolution) [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 2.85079 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:53:18] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 2.56918 [02/13/2023-19:53:18] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 11.3079 [02/13/2023-19:53:19] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf2 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x5030121339a48bf2 Time: 3.80471 [02/13/2023-19:53:19] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 2.64275 [02/13/2023-19:53:19] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 2.97376 [02/13/2023-19:53:19] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 2.60562 [02/13/2023-19:53:19] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d739 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xca7eeb8d9143d739 Time: 3.90048 [02/13/2023-19:53:19] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 4.71603 [02/13/2023-19:53:19] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf50 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xd9031472c05adf50 Time: 3.83952 [02/13/2023-19:53:19] [V] [TRT] Conv_11 + Relu_12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 2.48864 [02/13/2023-19:53:19] [V] [TRT] Fastest Tactic: 0xf48db81f02eca9ee Time: 2.48864 [02/13/2023-19:53:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf48db81f02eca9ee [02/13/2023-19:53:19] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,1024,4) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:53:19] [V] [TRT] --------------- Timing Runner: Conv_11 + Relu_12 (CaskConvolution) [02/13/2023-19:53:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:19] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:19] [V] [TRT] *************** Autotuning format combination: Float(589824,36864,256,1), Float(589824,36864,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:53:19] [V] [TRT] --------------- Timing Runner: Conv_13 + Add_14 (CudaDepthwiseConvolution) [02/13/2023-19:53:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:19] [V] [TRT] --------------- Timing Runner: Conv_13 + Add_14 (FusedConvActConvolution) [02/13/2023-19:53:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:19] [V] [TRT] --------------- Timing Runner: Conv_13 + Add_14 (CudnnConvolution) [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.11733 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.111447 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.157701 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x0000000000000004 Time: 3.51496 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.210432 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.118222 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.118165 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x000000000000003a Time: 0.156562 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x000000000000003c Time: 3.51806 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x000000000000003d Time: 0.211511 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.117138 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.115369 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.15883 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x0000000000000074 Time: 3.50499 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.215209 [02/13/2023-19:53:19] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.111447 [02/13/2023-19:53:19] [V] [TRT] --------------- Timing Runner: Conv_13 + Add_14 (CublasConvolution) [02/13/2023-19:53:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:19] [V] [TRT] --------------- Timing Runner: Conv_13 + Add_14 (CaskConvolution) [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.393426 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.187278 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.182432 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.220763 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.11368 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.448663 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.513646 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.216357 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0865097 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.340407 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.158601 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.288123 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.384827 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.15141 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.233545 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.137371 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.363054 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.247054 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.443515 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.240425 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.275118 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.116599 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.126821 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0612282 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.224046 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.468293 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.239081 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0621912 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.156814 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.230926 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0859497 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.456128 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.138857 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.297381 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.159255 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0866171 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.269865 [02/13/2023-19:53:19] [V] [TRT] Fastest Tactic: 0x9808072e706def96 Time: 0.0612282 [02/13/2023-19:53:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9808072e706def96 [02/13/2023-19:53:19] [V] [TRT] *************** Autotuning format combination: Float(589824,1,4096,16), Float(589824,1,4096,16) -> Float(589824,1,4096,16) *************** [02/13/2023-19:53:19] [V] [TRT] --------------- Timing Runner: Conv_13 + Add_14 (CublasConvolution) [02/13/2023-19:53:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:19] [V] [TRT] --------------- Timing Runner: Conv_13 + Add_14 (CaskConvolution) [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.181723 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.0477074 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0994491 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.133591 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.0500678 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.0754194 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.0569478 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0948434 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.118149 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.128711 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.103143 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.061187 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.119321 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.118825 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.0528305 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.0498301 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.11784 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.0551954 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.054563 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.173614 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.142759 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0903817 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.135282 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:19] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.168914 [02/13/2023-19:53:19] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0971497 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.0534034 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.116496 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.204576 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.203346 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.155991 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.0519177 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.133207 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.0578773 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.058205 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.159291 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0934834 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.0923794 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.0710034 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.0478232 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.0465531 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0976069 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.188722 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.0604023 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.120903 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.11544 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.0459474 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.057155 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.0533623 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.0782606 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xba269390692faead Time: 0.193934 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.165024 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.15899 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.174587 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.117831 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.0549242 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.0572815 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0956686 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.135673 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.052576 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.132114 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.0574065 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.207877 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.168658 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.141973 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.0627596 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.063715 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.134361 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.056384 [02/13/2023-19:53:20] [V] [TRT] Fastest Tactic: 0xae48d3ccfe1edfcd Time: 0.0459474 [02/13/2023-19:53:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:53:20] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,1024,4), Float(147456,1:4,1024,4) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:53:20] [V] [TRT] --------------- Timing Runner: Conv_13 + Add_14 (CublasConvolution) [02/13/2023-19:53:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:20] [V] [TRT] --------------- Timing Runner: Conv_13 + Add_14 (CaskConvolution) [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.04704 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.09864 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.0505768 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.078416 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.0582507 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0971566 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.130341 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.0612084 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.0529326 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.0498133 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.0555581 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.054525 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.174615 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.142485 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0897074 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.168247 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.0528716 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.116087 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.20432 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.203319 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.156283 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.0515063 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.0575512 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.0584076 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.160631 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.093312 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.0722263 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.0476446 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.045912 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0974377 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.188197 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.0612206 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.120958 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.046416 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.0572511 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.0533806 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.0776777 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xba269390692faead Time: 0.194496 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.164434 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.0541958 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.0569646 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.0527817 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.0576686 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.207662 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.169623 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.144009 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.0631619 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.063264 [02/13/2023-19:53:20] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:53:20] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.0566019 [02/13/2023-19:53:20] [V] [TRT] Fastest Tactic: 0x9cb304e2edbc1221 Time: 0.045912 [02/13/2023-19:53:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:53:20] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:20] [V] [TRT] *************** Autotuning format combination: Float(589824,36864,256,1) -> Float(2359296,36864,256,1) *************** [02/13/2023-19:53:20] [V] [TRT] --------------- Timing Runner: Conv_15 + Relu_16 (CudaDepthwiseConvolution) [02/13/2023-19:53:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:20] [V] [TRT] --------------- Timing Runner: Conv_15 + Relu_16 (FusedConvActConvolution) [02/13/2023-19:53:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:20] [V] [TRT] --------------- Timing Runner: Conv_15 + Relu_16 (CudnnConvolution) [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.41275 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.344521 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.451031 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x0000000000000004 Time: 14.8691 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.538825 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.412969 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.34747 [02/13/2023-19:53:20] [V] [TRT] Tactic: 0x000000000000003a Time: 0.452279 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x000000000000003c Time: 14.6619 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x000000000000003d Time: 0.536768 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.411058 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.346651 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.450693 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x0000000000000074 Time: 14.8461 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.539497 [02/13/2023-19:53:21] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.344521 [02/13/2023-19:53:21] [V] [TRT] --------------- Timing Runner: Conv_15 + Relu_16 (CublasConvolution) [02/13/2023-19:53:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:21] [V] [TRT] --------------- Timing Runner: Conv_15 + Relu_16 (CaskConvolution) [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.342615 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.293947 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.152503 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.351899 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.11021 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.29936 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.401472 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.177422 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0932366 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.302107 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.14416 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.197737 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.248361 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.136265 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.195049 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.11955 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.267781 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.211483 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.304462 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.150176 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.172151 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.113769 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.116613 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.092944 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.199561 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.377719 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.141161 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0970583 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.142857 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.207333 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0928069 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.310597 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.122306 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.252535 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.143808 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0942697 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.185307 [02/13/2023-19:53:21] [V] [TRT] Fastest Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0928069 [02/13/2023-19:53:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:53:21] [V] [TRT] *************** Autotuning format combination: Float(589824,1,4096,16) -> Float(2359296,1,16384,64) *************** [02/13/2023-19:53:21] [V] [TRT] --------------- Timing Runner: Conv_15 + Relu_16 (CublasConvolution) [02/13/2023-19:53:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:21] [V] [TRT] --------------- Timing Runner: Conv_15 + Relu_16 (CaskConvolution) [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.159973 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0792617 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.118946 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0840777 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0993989 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0949897 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0932434 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.171771 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.170455 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.100507 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.141198 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.108514 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0804709 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.119947 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.124455 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.089968 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0980617 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.163877 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.156293 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.115371 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.119214 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.214583 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.08536 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0773851 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.146208 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.100462 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.098384 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xba269390692faead Time: 0.150377 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.120334 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.107442 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.153257 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.167721 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0913806 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.119744 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.117193 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.166738 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.231621 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.103145 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.118398 [02/13/2023-19:53:21] [V] [TRT] Fastest Tactic: 0x9dece0dc37e90462 Time: 0.0773851 [02/13/2023-19:53:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:21] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,1024,4) -> Float(589824,1:4,4096,16) *************** [02/13/2023-19:53:21] [V] [TRT] --------------- Timing Runner: Conv_15 + Relu_16 (CublasConvolution) [02/13/2023-19:53:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:21] [V] [TRT] --------------- Timing Runner: Conv_15 + Relu_16 (CaskConvolution) [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0787726 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0838674 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0951497 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.14141 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.107808 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0793349 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.122798 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0981874 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.16219 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.155291 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.115344 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.214592 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0781143 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.146098 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.100411 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xba269390692faead Time: 0.150757 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.12075 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.167653 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.232649 [02/13/2023-19:53:21] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.103429 [02/13/2023-19:53:21] [V] [TRT] Fastest Tactic: 0x9dece0dc37e90462 Time: 0.0781143 [02/13/2023-19:53:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:21] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:21] [V] [TRT] *************** Autotuning format combination: Float(2359296,36864,256,1) -> Float(589824,9216,128,1) *************** [02/13/2023-19:53:21] [V] [TRT] --------------- Timing Runner: Conv_17 + Relu_18 (CudaDepthwiseConvolution) [02/13/2023-19:53:21] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.127321 [02/13/2023-19:53:21] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.127321 [02/13/2023-19:53:21] [V] [TRT] --------------- Timing Runner: Conv_17 + Relu_18 (CudnnConvolution) [02/13/2023-19:53:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.158738 [02/13/2023-19:53:22] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.155941 [02/13/2023-19:53:22] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.157632 [02/13/2023-19:53:22] [V] [TRT] Tactic: 0x0000000000000005 Time: 47.2152 [02/13/2023-19:53:22] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.158085 [02/13/2023-19:53:22] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.159058 [02/13/2023-19:53:22] [V] [TRT] Tactic: 0x000000000000003a Time: 0.155049 [02/13/2023-19:53:22] [V] [TRT] Tactic: 0x000000000000003d Time: 47.3172 [02/13/2023-19:53:22] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.155881 [02/13/2023-19:53:22] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.156969 [02/13/2023-19:53:22] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.156 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x0000000000000075 Time: 47.2312 [02/13/2023-19:53:23] [V] [TRT] Fastest Tactic: 0x000000000000003a Time: 0.155049 [02/13/2023-19:53:23] [V] [TRT] --------------- Timing Runner: Conv_17 + Relu_18 (CaskConvolution) [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 3.77206 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 2.378 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 1.70113 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x4727434768e46395 Time: 1.82771 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 4.14028 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 2.67227 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 3.4603 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 3.86619 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 1.67649 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:53:23] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 1.91614 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 1.04387 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 4.27574 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 2.10568 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:53:23] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 2.64382 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 1.7286 [02/13/2023-19:53:23] [V] [TRT] Fastest Tactic: 0xa8609adc4e0ceb90 Time: 1.04387 [02/13/2023-19:53:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 0xffffffffffffffff [02/13/2023-19:53:23] [V] [TRT] *************** Autotuning format combination: Float(2359296,1,16384,64) -> Float(589824,1,8192,64) *************** [02/13/2023-19:53:23] [V] [TRT] --------------- Timing Runner: Conv_17 + Relu_18 (CaskConvolution) [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 3.87679 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 3.74427 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 13.6124 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf2 [02/13/2023-19:53:23] [V] [TRT] Tactic: 0x5030121339a48bf2 Time: 3.82353 [02/13/2023-19:53:23] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 3.4836 [02/13/2023-19:53:24] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 5.53635 [02/13/2023-19:53:24] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 3.38582 [02/13/2023-19:53:24] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d739 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xca7eeb8d9143d739 Time: 3.90092 [02/13/2023-19:53:24] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 5.3136 [02/13/2023-19:53:24] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf50 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xd9031472c05adf50 Time: 3.85226 [02/13/2023-19:53:24] [V] [TRT] Conv_17 + Relu_18 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 3.6164 [02/13/2023-19:53:24] [V] [TRT] Fastest Tactic: 0x94a7db94ba744c45 Time: 3.38582 [02/13/2023-19:53:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94a7db94ba744c45 [02/13/2023-19:53:24] [V] [TRT] *************** Autotuning format combination: Float(589824,1:4,4096,16) -> Float(147456,1:4,2048,16) *************** [02/13/2023-19:53:24] [V] [TRT] --------------- Timing Runner: Conv_17 + Relu_18 (CaskConvolution) [02/13/2023-19:53:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:24] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:24] [V] [TRT] *************** Autotuning format combination: Float(589824,9216,128,1) -> Float(221184,9216,128,1) *************** [02/13/2023-19:53:24] [V] [TRT] --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [02/13/2023-19:53:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:24] [V] [TRT] --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.124736 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.104192 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.103145 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.131931 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000011ffff Time: 0.0822949 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.0932366 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000001fffff Time: 0.0938583 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.086528 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.120366 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000003cffff Time: 0.100777 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.0985074 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000040ffff Time: 0.0903086 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000045ffff Time: 0.0961051 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000046ffff Time: 0.0909257 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000004affff Time: 0.0940663 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.0974491 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000004effff Time: 0.089488 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.0931109 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000051ffff Time: 0.100149 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.0987429 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.211022 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000059ffff Time: 0.0819543 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000005effff Time: 0.0926126 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000005fffff Time: 0.0837417 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.109166 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000006affff Time: 0.0931269 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.0899954 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.133863 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.094352 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000006fffff Time: 0.0874651 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.124416 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.0843954 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.114832 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.11064 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000008affff Time: 0.0988686 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000091ffff Time: 0.0970789 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x00000000009dffff Time: 0.0958149 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.0822971 [02/13/2023-19:53:24] [V] [TRT] Fastest Tactic: 0x000000000059ffff Time: 0.0819543 [02/13/2023-19:53:24] [V] [TRT] --------------- Timing Runner: Conv_19 (CudnnConvolution) [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0426366 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0335954 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.107639 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x0000000000000004 Time: 4.38341 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.155904 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0452971 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.034016 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000000003a Time: 0.105515 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000000003c Time: 4.9502 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x000000000000003d Time: 0.160631 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0462926 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0480823 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.108521 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x0000000000000074 Time: 4.37242 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.155657 [02/13/2023-19:53:24] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0335954 [02/13/2023-19:53:24] [V] [TRT] --------------- Timing Runner: Conv_19 (CublasConvolution) [02/13/2023-19:53:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:24] [V] [TRT] --------------- Timing Runner: Conv_19 (CaskConvolution) [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0929074 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.042376 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0477379 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0523779 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0476754 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0959337 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.182976 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0548541 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.046288 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0863223 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0750514 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0737874 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0773531 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0524434 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0547307 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0448903 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0767657 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0542964 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.091072 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0580465 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0677638 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0490865 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0544198 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0289454 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0945989 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.176032 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0526613 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0318976 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.074928 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0969806 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0434491 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0988046 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0619246 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0629836 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0745989 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0456686 [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:53:24] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.102946 [02/13/2023-19:53:24] [V] [TRT] Fastest Tactic: 0x9808072e706def96 Time: 0.0289454 [02/13/2023-19:53:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9808072e706def96 [02/13/2023-19:53:24] [V] [TRT] *************** Autotuning format combination: Float(589824,1,8192,64) -> Float(221184,1,3072,24) *************** [02/13/2023-19:53:24] [V] [TRT] --------------- Timing Runner: Conv_19 (CublasConvolution) [02/13/2023-19:53:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:24] [V] [TRT] --------------- Timing Runner: Conv_19 (CaskConvolution) [02/13/2023-19:53:24] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.071936 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0306313 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0659429 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0273204 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0455577 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.026419 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0463783 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0333861 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0330286 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0442503 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0308507 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0271284 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0252282 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0697463 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0395406 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0415634 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0355648 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0560366 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.044512 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0315712 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0650545 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0302363 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0397577 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0334245 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0339017 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0364229 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0451749 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0426411 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0412469 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0577082 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0728412 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0317842 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.042328 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0695909 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0679619 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0544823 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0294885 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0287963 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0654735 [02/13/2023-19:53:25] [V] [TRT] Fastest Tactic: 0x4ddd867d1da71041 Time: 0.0252282 [02/13/2023-19:53:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:25] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,2048,16) -> Float(55296,1:4,768,6) *************** [02/13/2023-19:53:25] [V] [TRT] --------------- Timing Runner: Conv_19 (CublasConvolution) [02/13/2023-19:53:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:25] [V] [TRT] --------------- Timing Runner: Conv_19 (CaskConvolution) [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0307657 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0270347 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0247764 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.031467 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0287177 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0253752 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.039832 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0351451 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.053725 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0416057 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0309248 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0267383 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0293925 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0375143 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0384503 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0395303 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0376617 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0553128 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0331831 [02/13/2023-19:53:25] [V] [TRT] Conv_19 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0288786 [02/13/2023-19:53:25] [V] [TRT] Fastest Tactic: 0x2b4a5a2f546acbfd Time: 0.0247764 [02/13/2023-19:53:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:25] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:25] [V] [TRT] *************** Autotuning format combination: Float(221184,9216,128,1) -> Float(663552,9216,128,1) *************** [02/13/2023-19:53:25] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaDepthwiseConvolution) [02/13/2023-19:53:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:25] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (FusedConvActConvolution) [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.269253 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.245449 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.260891 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.241509 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.247621 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.252274 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.251346 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.259794 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.260603 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.260361 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.23184 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.316517 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x00000000005effff Time: 0.256233 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.265467 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.254839 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.280133 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.263442 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.270615 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.250565 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.272649 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.260306 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.250025 [02/13/2023-19:53:25] [V] [TRT] Fastest Tactic: 0x000000000054ffff Time: 0.23184 [02/13/2023-19:53:25] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudnnConvolution) [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0954332 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0961143 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.122837 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x0000000000000004 Time: 6.28966 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.231781 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.102528 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0902789 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x000000000000003a Time: 0.119301 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x000000000000003c Time: 6.20544 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x000000000000003d Time: 0.234857 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.101191 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0805074 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.122418 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x0000000000000074 Time: 6.2716 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.236238 [02/13/2023-19:53:25] [V] [TRT] Fastest Tactic: 0x0000000000000071 Time: 0.0805074 [02/13/2023-19:53:25] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CublasConvolution) [02/13/2023-19:53:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:25] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CaskConvolution) [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0905623 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.10888 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0741531 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.131173 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0596785 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0881029 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.126215 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0894629 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0477608 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.151845 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0508373 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0693882 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0741714 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0761074 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0988183 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0638019 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0686949 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.102846 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0859657 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0504122 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0622339 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0594926 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0684099 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0376309 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0668541 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.117031 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0497996 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0362286 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0511589 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0650697 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0488655 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0920594 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0714499 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.126208 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0495162 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0471874 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0669836 [02/13/2023-19:53:25] [V] [TRT] Fastest Tactic: 0xa8609adc4e0ceb90 Time: 0.0362286 [02/13/2023-19:53:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:25] [V] [TRT] *************** Autotuning format combination: Float(221184,1,3072,24) -> Float(663552,1,9216,72) *************** [02/13/2023-19:53:25] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CublasConvolution) [02/13/2023-19:53:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:25] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CaskConvolution) [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0489859 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0276229 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0442503 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0400743 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0575802 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0413063 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0510202 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0652038 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0675886 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.058557 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0539794 [02/13/2023-19:53:25] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:25] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0468971 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0372971 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.045936 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0354633 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0497813 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0333038 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0480731 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0425726 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0528076 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0463726 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0712716 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0497524 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0292818 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0701211 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0328823 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0607147 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0419086 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0386297 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0629257 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.046856 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0662949 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0501409 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0405234 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0434537 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0512914 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0817394 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0463874 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0443703 [02/13/2023-19:53:26] [V] [TRT] Fastest Tactic: 0x130df49cb195156b Time: 0.0276229 [02/13/2023-19:53:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x130df49cb195156b [02/13/2023-19:53:26] [V] [TRT] *************** Autotuning format combination: Float(55296,1:4,768,6) -> Float(165888,1:4,2304,18) *************** [02/13/2023-19:53:26] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CublasConvolution) [02/13/2023-19:53:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:26] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CaskConvolution) [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0274895 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0379634 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0396663 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0539337 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0425463 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0332206 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0367977 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.031808 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0460674 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.04108 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0526781 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0724069 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0312329 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0674362 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0362857 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0374869 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0325111 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0520869 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0789783 [02/13/2023-19:53:26] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.041664 [02/13/2023-19:53:26] [V] [TRT] Fastest Tactic: 0x130df49cb195156b Time: 0.0274895 [02/13/2023-19:53:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x130df49cb195156b [02/13/2023-19:53:26] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:26] [V] [TRT] *************** Autotuning format combination: Float(663552,9216,128,1) -> Float(663552,9216,128,1) *************** [02/13/2023-19:53:26] [V] [TRT] --------------- Timing Runner: Conv_22 + Relu_23 (CudaDepthwiseConvolution) [02/13/2023-19:53:26] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.0610011 [02/13/2023-19:53:26] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.0610011 [02/13/2023-19:53:26] [V] [TRT] --------------- Timing Runner: Conv_22 + Relu_23 (CudnnConvolution) [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.139701 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.137015 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.142078 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x0000000000000004 Time: 27.8191 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x0000000000000005 Time: 19.9512 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x0000000000000006 Time: 1.38432 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.140608 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.137849 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x000000000000003a Time: 0.137223 [02/13/2023-19:53:26] [V] [TRT] Tactic: 0x000000000000003c Time: 27.8708 [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x000000000000003d Time: 19.7264 [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x000000000000003e Time: 1.37839 [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.140185 [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.136981 [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.137554 [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x0000000000000074 Time: 27.8934 [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x0000000000000075 Time: 19.9742 [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x0000000000000076 Time: 1.38247 [02/13/2023-19:53:27] [V] [TRT] Fastest Tactic: 0x0000000000000071 Time: 0.136981 [02/13/2023-19:53:27] [V] [TRT] --------------- Timing Runner: Conv_22 + Relu_23 (CaskConvolution) [02/13/2023-19:53:27] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 4.17536 [02/13/2023-19:53:27] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 2.65035 [02/13/2023-19:53:27] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 1.87294 [02/13/2023-19:53:27] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x4727434768e46395 Time: 2.03509 [02/13/2023-19:53:27] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 4.63592 [02/13/2023-19:53:27] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 2.96825 [02/13/2023-19:53:27] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 3.86826 [02/13/2023-19:53:27] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 4.33771 [02/13/2023-19:53:27] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:53:27] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 1.85231 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 1.77228 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:53:28] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 2.16219 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 1.14571 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 4.7861 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 2.36761 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:53:28] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 2.95876 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 1.92558 [02/13/2023-19:53:28] [V] [TRT] Fastest Tactic: 0xa8609adc4e0ceb90 Time: 1.14571 [02/13/2023-19:53:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 0xffffffffffffffff [02/13/2023-19:53:28] [V] [TRT] *************** Autotuning format combination: Float(663552,1,9216,72) -> Float(663552,1,9216,72) *************** [02/13/2023-19:53:28] [V] [TRT] --------------- Timing Runner: Conv_22 + Relu_23 (CaskConvolution) [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 3.56878 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 3.43931 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 14.6604 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf2 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x5030121339a48bf2 Time: 4.27514 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 3.26923 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 4.50126 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 3.15466 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d739 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0xca7eeb8d9143d739 Time: 4.37951 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 5.56416 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf50 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0xd9031472c05adf50 Time: 4.3412 [02/13/2023-19:53:28] [V] [TRT] Conv_22 + Relu_23 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:53:28] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 3.40803 [02/13/2023-19:53:28] [V] [TRT] Fastest Tactic: 0x94a7db94ba744c45 Time: 3.15466 [02/13/2023-19:53:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94a7db94ba744c45 [02/13/2023-19:53:28] [V] [TRT] *************** Autotuning format combination: Float(165888,1:4,2304,18) -> Float(165888,1:4,2304,18) *************** [02/13/2023-19:53:28] [V] [TRT] --------------- Timing Runner: Conv_22 + Relu_23 (CaskConvolution) [02/13/2023-19:53:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:28] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:28] [V] [TRT] *************** Autotuning format combination: Float(663552,9216,128,1), Float(221184,9216,128,1) -> Float(221184,9216,128,1) *************** [02/13/2023-19:53:28] [V] [TRT] --------------- Timing Runner: Conv_24 + Add_25 (CudaDepthwiseConvolution) [02/13/2023-19:53:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:28] [V] [TRT] --------------- Timing Runner: Conv_24 + Add_25 (FusedConvActConvolution) [02/13/2023-19:53:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:28] [V] [TRT] --------------- Timing Runner: Conv_24 + Add_25 (CudnnConvolution) [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0659093 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0547246 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.13272 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x0000000000000004 Time: 5.42641 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.19435 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0664823 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0538103 [02/13/2023-19:53:28] [V] [TRT] Tactic: 0x000000000000003a Time: 0.13285 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x000000000000003c Time: 5.49408 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x000000000000003d Time: 0.194907 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0635886 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0691703 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.134738 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x0000000000000074 Time: 5.37454 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.194062 [02/13/2023-19:53:29] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.0538103 [02/13/2023-19:53:29] [V] [TRT] --------------- Timing Runner: Conv_24 + Add_25 (CublasConvolution) [02/13/2023-19:53:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:29] [V] [TRT] --------------- Timing Runner: Conv_24 + Add_25 (CaskConvolution) [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.12144 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0665189 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0687589 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0757737 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0583893 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.188165 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.250464 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0786583 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0551147 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.122805 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0895291 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.129047 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.155653 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0672351 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0895086 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0643672 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.112293 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0830857 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.156146 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.114281 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.140391 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0583284 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0733851 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0388389 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.111438 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.214766 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.105472 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0423931 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0882012 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.114315 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0534232 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.182322 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0721577 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0952846 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0907337 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0587032 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.166103 [02/13/2023-19:53:29] [V] [TRT] Fastest Tactic: 0x9808072e706def96 Time: 0.0388389 [02/13/2023-19:53:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9808072e706def96 [02/13/2023-19:53:29] [V] [TRT] *************** Autotuning format combination: Float(663552,1,9216,72), Float(221184,1,3072,24) -> Float(221184,1,3072,24) *************** [02/13/2023-19:53:29] [V] [TRT] --------------- Timing Runner: Conv_24 + Add_25 (CublasConvolution) [02/13/2023-19:53:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:29] [V] [TRT] --------------- Timing Runner: Conv_24 + Add_25 (CaskConvolution) [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0851154 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0432571 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0830606 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0425783 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0653745 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.051421 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0606872 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0531962 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.055517 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0559086 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.057504 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0559314 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0384411 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0837851 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0579337 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0499337 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.053859 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0787589 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0721623 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0520884 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0820206 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0477821 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0505417 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.044536 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0594194 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0590644 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0687619 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0686918 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0587337 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0909737 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0834766 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0447737 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0524069 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.079856 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0811429 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0764594 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0532968 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0456629 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0808023 [02/13/2023-19:53:29] [V] [TRT] Fastest Tactic: 0x4ddd867d1da71041 Time: 0.0384411 [02/13/2023-19:53:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:29] [V] [TRT] *************** Autotuning format combination: Float(165888,1:4,2304,18), Float(55296,1:4,768,6) -> Float(55296,1:4,768,6) *************** [02/13/2023-19:53:29] [V] [TRT] --------------- Timing Runner: Conv_24 + Add_25 (CublasConvolution) [02/13/2023-19:53:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:29] [V] [TRT] --------------- Timing Runner: Conv_24 + Add_25 (CaskConvolution) [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0426651 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0405566 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.042904 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0549013 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0497463 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0397931 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.059907 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.052512 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0782057 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0700465 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0531474 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0510827 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0426777 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0552107 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.052419 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0663924 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0603703 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0797737 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0548145 [02/13/2023-19:53:29] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0449349 [02/13/2023-19:53:29] [V] [TRT] Fastest Tactic: 0x4ddd867d1da71041 Time: 0.0397931 [02/13/2023-19:53:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:29] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:29] [V] [TRT] *************** Autotuning format combination: Float(221184,9216,128,1) -> Float(663552,9216,128,1) *************** [02/13/2023-19:53:29] [V] [TRT] *************** Autotuning format combination: Float(221184,1,3072,24) -> Float(663552,1,9216,72) *************** [02/13/2023-19:53:29] [V] [TRT] *************** Autotuning format combination: Float(55296,1:4,768,6) -> Float(165888,1:4,2304,18) *************** [02/13/2023-19:53:29] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:29] [V] [TRT] *************** Autotuning format combination: Float(663552,9216,128,1) -> Float(165888,2304,64,1) *************** [02/13/2023-19:53:29] [V] [TRT] --------------- Timing Runner: Conv_28 + Relu_29 (CudaDepthwiseConvolution) [02/13/2023-19:53:29] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.0509531 [02/13/2023-19:53:29] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.0509531 [02/13/2023-19:53:29] [V] [TRT] --------------- Timing Runner: Conv_28 + Relu_29 (CudnnConvolution) [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0709851 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0714766 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0708221 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x0000000000000005 Time: 19.7077 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0702491 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0744023 [02/13/2023-19:53:29] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0710735 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x000000000000003d Time: 19.7084 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0728183 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0772434 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0776297 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000075 Time: 19.7247 [02/13/2023-19:53:30] [V] [TRT] Fastest Tactic: 0x0000000000000038 Time: 0.0702491 [02/13/2023-19:53:30] [V] [TRT] --------------- Timing Runner: Conv_28 + Relu_29 (CaskConvolution) [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 1.40479 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 1.18 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 1.73475 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 2.03467 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 2.02661 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 1.16403 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r5s5_aligna4_alignc4 Tactic: 0x967f94e9db2001a8 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x967f94e9db2001a8 Time: 1.11685 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:53:30] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 1.12894 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.995662 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 2.19978 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 1.28629 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:53:30] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 1.73071 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 1.27612 [02/13/2023-19:53:30] [V] [TRT] Fastest Tactic: 0xa8609adc4e0ceb90 Time: 0.995662 [02/13/2023-19:53:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 0xffffffffffffffff [02/13/2023-19:53:30] [V] [TRT] *************** Autotuning format combination: Float(663552,1,9216,72) -> Float(165888,1,4608,72) *************** [02/13/2023-19:53:30] [V] [TRT] --------------- Timing Runner: Conv_28 + Relu_29 (CaskConvolution) [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 2.6833 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 2.95049 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r5s5_aligna4_alignc4 Tactic: 0x45ff0c3a09b02e78 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x45ff0c3a09b02e78 Time: 2.37501 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf2 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x5030121339a48bf2 Time: 2.69245 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 2.48293 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 3.27097 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d739 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0xca7eeb8d9143d739 Time: 2.73338 [02/13/2023-19:53:30] [V] [TRT] Conv_28 + Relu_29 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf50 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0xd9031472c05adf50 Time: 2.72175 [02/13/2023-19:53:30] [V] [TRT] Fastest Tactic: 0x45ff0c3a09b02e78 Time: 2.37501 [02/13/2023-19:53:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x45ff0c3a09b02e78 [02/13/2023-19:53:30] [V] [TRT] *************** Autotuning format combination: Float(165888,1:4,2304,18) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:53:30] [V] [TRT] --------------- Timing Runner: Conv_28 + Relu_29 (CaskConvolution) [02/13/2023-19:53:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:30] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:30] [V] [TRT] *************** Autotuning format combination: Float(165888,2304,64,1) -> Float(72,1,1,1) *************** [02/13/2023-19:53:30] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_30 (TiledPooling) [02/13/2023-19:53:30] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [02/13/2023-19:53:30] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_30 (CudnnPooling) [02/13/2023-19:53:30] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.0117243 [02/13/2023-19:53:30] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.0117243 [02/13/2023-19:53:30] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_30 (CaskPooling) [02/13/2023-19:53:30] [V] [TRT] GlobalAveragePool_30 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Average_FastDiv Tactic: 0x933eceba7b866d59 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x933eceba7b866d59 Time: 0.0119352 [02/13/2023-19:53:30] [V] [TRT] Fastest Tactic: 0x933eceba7b866d59 Time: 0.0119352 [02/13/2023-19:53:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: 0xffffffffffffffff [02/13/2023-19:53:30] [V] [TRT] *************** Autotuning format combination: Float(41472,1:4,1152,18) -> Float(18,1:4,18,18) *************** [02/13/2023-19:53:30] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_30 (CaskPooling) [02/13/2023-19:53:30] [V] [TRT] GlobalAveragePool_30 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Average_FastDiv_CAlign4 Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:53:30] [V] [TRT] Tactic: 0xfab3e2ee1c085a9a Time: 0.0110674 [02/13/2023-19:53:30] [V] [TRT] Fastest Tactic: 0xfab3e2ee1c085a9a Time: 0.0110674 [02/13/2023-19:53:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:53:30] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:30] [V] [TRT] *************** Autotuning format combination: Float(72,1,1,1) -> Float(24,1,1,1) *************** [02/13/2023-19:53:30] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (CudaDepthwiseConvolution) [02/13/2023-19:53:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:30] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (FusedConvActConvolution) [02/13/2023-19:53:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:30] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (CudnnConvolution) [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.018688 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0159289 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0307447 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0621333 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0385509 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.018536 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0160071 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0308809 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x000000000000003c Time: 0.0619109 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x000000000000003d Time: 0.0383486 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.018756 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0232078 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0309915 [02/13/2023-19:53:30] [V] [TRT] Tactic: 0x0000000000000074 Time: 0.0620846 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.0384229 [02/13/2023-19:53:31] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0159289 [02/13/2023-19:53:31] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (CublasConvolution) [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0121044 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0120743 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0123996 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0119928 [02/13/2023-19:53:31] [V] [TRT] Fastest Tactic: 0x0000000000000003 Time: 0.0119928 [02/13/2023-19:53:31] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (CaskConvolution) [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0141132 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.00894771 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0135751 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.00931229 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0105293 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0226645 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0267726 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0143552 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0181543 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0222602 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0222073 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0279627 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0201566 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0202526 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0160462 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0181931 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0117946 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.00997059 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0224581 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0176904 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0262377 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0104594 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.015903 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0183863 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0156462 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.026621 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0160213 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0187709 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0207843 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xaa0953b1a73b0b9b Time: 0.00616076 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0160122 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0181086 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0242469 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0161387 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0116269 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0221923 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0183583 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0379063 [02/13/2023-19:53:31] [V] [TRT] Fastest Tactic: 0xaa0953b1a73b0b9b Time: 0.00616076 [02/13/2023-19:53:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:53:31] [V] [TRT] *************** Autotuning format combination: Float(72,1,72,72) -> Float(24,1,24,24) *************** [02/13/2023-19:53:31] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (CublasConvolution) [02/13/2023-19:53:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:31] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (CaskConvolution) [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0139703 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0104908 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0200811 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0115924 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0157847 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.00844182 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0139096 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0134288 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0135817 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0158816 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00724914 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.009422 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0109048 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0201829 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0114775 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.00982552 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.014464 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0142142 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.00898343 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.00969631 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.019992 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.00703064 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.00964358 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0100245 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.00746446 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0156434 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0142014 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xba269390692faead Time: 0.00870319 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0113034 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0224614 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0136914 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0122484 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0138065 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0203229 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.02034 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0154272 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0071212 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.00923343 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0198794 [02/13/2023-19:53:31] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.00703064 [02/13/2023-19:53:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:53:31] [V] [TRT] *************** Autotuning format combination: Float(18,1:4,18,18) -> Float(6,1:4,6,6) *************** [02/13/2023-19:53:31] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (CublasConvolution) [02/13/2023-19:53:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:31] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (CaskConvolution) [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0107647 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0115379 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.00848108 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00760373 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.00926714 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0106155 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0114606 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0144411 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0140904 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.00899343 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.00976457 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.00713165 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.00984107 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.00760469 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0155634 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xba269390692faead Time: 0.00878494 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0114265 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0148183 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.007344 [02/13/2023-19:53:31] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.00919314 [02/13/2023-19:53:31] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.00713165 [02/13/2023-19:53:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:53:31] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:31] [V] [TRT] *************** Autotuning format combination: Float(24,1,1,1) -> Float(72,1,1,1) *************** [02/13/2023-19:53:31] [V] [TRT] --------------- Timing Runner: Conv_33 (CudaDepthwiseConvolution) [02/13/2023-19:53:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:31] [V] [TRT] --------------- Timing Runner: Conv_33 (FusedConvActConvolution) [02/13/2023-19:53:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:31] [V] [TRT] --------------- Timing Runner: Conv_33 (CudnnConvolution) [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012755 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0126297 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0149751 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0663665 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0338834 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0127684 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0127349 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0149381 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x000000000000003c Time: 0.0673143 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x000000000000003d Time: 0.0333257 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0126728 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0127669 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0150062 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000074 Time: 0.0679832 [02/13/2023-19:53:31] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.0336539 [02/13/2023-19:53:31] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0126297 [02/13/2023-19:53:31] [V] [TRT] --------------- Timing Runner: Conv_33 (CublasConvolution) [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0120472 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0120282 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0128046 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0121261 [02/13/2023-19:53:32] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0120282 [02/13/2023-19:53:32] [V] [TRT] --------------- Timing Runner: Conv_33 (CaskConvolution) [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0118217 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.00746971 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0113741 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.00907886 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0087516 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0182474 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0196749 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0125878 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0136794 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.018756 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0139138 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0224908 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0157381 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0160208 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.013846 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0140788 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.00978377 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.00933114 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0178311 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0149705 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0201686 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.00881398 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.011821 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0124263 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0114581 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.0180851 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0138369 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0135202 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0140006 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xaa0953b1a73b0b9b Time: 0.00582052 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0117324 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0128979 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0182509 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0131404 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0101272 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.014043 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0137829 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0236441 [02/13/2023-19:53:32] [V] [TRT] Fastest Tactic: 0xaa0953b1a73b0b9b Time: 0.00582052 [02/13/2023-19:53:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:53:32] [V] [TRT] *************** Autotuning format combination: Float(24,1,24,24) -> Float(72,1,72,72) *************** [02/13/2023-19:53:32] [V] [TRT] --------------- Timing Runner: Conv_33 (CublasConvolution) [02/13/2023-19:53:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:32] [V] [TRT] --------------- Timing Runner: Conv_33 (CaskConvolution) [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0105466 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.00915171 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0120107 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.00949514 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0115984 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.00746766 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0114303 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.00993402 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0098688 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0117285 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00749646 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.00799822 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.00908114 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0119272 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.00907486 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.008958 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0114026 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0113269 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.00722697 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.00927971 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0118491 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.00695467 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.00785251 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.00899 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.00733989 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0115738 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0115889 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xba269390692faead Time: 0.00710378 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.00913628 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0161026 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.00978621 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.00979566 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0106704 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0120297 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0118309 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0116445 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0072096 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.00786887 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0119075 [02/13/2023-19:53:32] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.00695467 [02/13/2023-19:53:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:53:32] [V] [TRT] *************** Autotuning format combination: Float(6,1:4,6,6) -> Float(18,1:4,18,18) *************** [02/13/2023-19:53:32] [V] [TRT] --------------- Timing Runner: Conv_33 (CublasConvolution) [02/13/2023-19:53:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:32] [V] [TRT] --------------- Timing Runner: Conv_33 (CaskConvolution) [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.00905486 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.00937457 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0074688 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00719109 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.00800152 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.00911971 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.00906943 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0114486 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0114884 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.00733326 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.00919972 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.00716891 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.00890649 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.00730697 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0116687 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xba269390692faead Time: 0.00728069 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.00891993 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0117236 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.00749737 [02/13/2023-19:53:32] [V] [TRT] Conv_33 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:32] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.00791771 [02/13/2023-19:53:32] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.00716891 [02/13/2023-19:53:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:53:32] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:32] [V] [TRT] *************** Autotuning format combination: Float(72,1,1,1), Float(165888,2304,64,1) -> Float(165888,2304,64,1) *************** [02/13/2023-19:53:32] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_34), Mul_35) (PointWiseV2) [02/13/2023-19:53:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139387 [02/13/2023-19:53:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0114701 [02/13/2023-19:53:33] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0100608 [02/13/2023-19:53:33] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0119173 [02/13/2023-19:53:33] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0119787 [02/13/2023-19:53:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0117528 [02/13/2023-19:53:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.014191 [02/13/2023-19:53:34] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0138676 [02/13/2023-19:53:35] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0139682 [02/13/2023-19:53:35] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0140131 [02/13/2023-19:53:35] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0139275 [02/13/2023-19:53:35] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.0100608 [02/13/2023-19:53:35] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_34), Mul_35) (PointWise) [02/13/2023-19:53:35] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:53:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [02/13/2023-19:53:35] [V] [TRT] *************** Autotuning format combination: Float(72,1,72,72), Float(165888,1,4608,72) -> Float(165888,1,4608,72) *************** [02/13/2023-19:53:35] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_34), Mul_35) (PointWiseV2) [02/13/2023-19:53:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0202594 [02/13/2023-19:53:36] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0181794 [02/13/2023-19:53:36] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0165206 [02/13/2023-19:53:36] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0122594 [02/13/2023-19:53:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.013526 [02/13/2023-19:53:37] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.011973 [02/13/2023-19:53:37] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0142358 [02/13/2023-19:53:38] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.015179 [02/13/2023-19:53:38] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0153787 [02/13/2023-19:53:38] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0140472 [02/13/2023-19:53:39] [V] [TRT] Tactic: 0x000000000000001c Time: 0.016061 [02/13/2023-19:53:39] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.011973 [02/13/2023-19:53:39] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_34), Mul_35) (PointWise) [02/13/2023-19:53:39] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:53:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:53:39] [V] [TRT] *************** Autotuning format combination: Float(18,1:4,18,18), Float(41472,1:4,1152,18) -> Float(41472,1:4,1152,18) *************** [02/13/2023-19:53:39] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_34), Mul_35) (PointWiseV2) [02/13/2023-19:53:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0152686 [02/13/2023-19:53:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0153774 [02/13/2023-19:53:40] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0154555 [02/13/2023-19:53:40] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0160899 [02/13/2023-19:53:40] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0163601 [02/13/2023-19:53:40] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0150953 [02/13/2023-19:53:41] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0194183 [02/13/2023-19:53:41] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0190114 [02/13/2023-19:53:41] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0188714 [02/13/2023-19:53:42] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0167766 [02/13/2023-19:53:42] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0168645 [02/13/2023-19:53:43] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0139636 [02/13/2023-19:53:43] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0138876 [02/13/2023-19:53:43] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0144247 [02/13/2023-19:53:43] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0146747 [02/13/2023-19:53:44] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0138082 [02/13/2023-19:53:44] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0171835 [02/13/2023-19:53:44] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0171561 [02/13/2023-19:53:45] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.017475 [02/13/2023-19:53:45] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0144343 [02/13/2023-19:53:45] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0223641 [02/13/2023-19:53:46] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0202537 [02/13/2023-19:53:46] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0139183 [02/13/2023-19:53:46] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0180731 [02/13/2023-19:53:47] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0121996 [02/13/2023-19:53:47] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0123562 [02/13/2023-19:53:47] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0181371 [02/13/2023-19:53:47] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0121996 [02/13/2023-19:53:47] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_34), Mul_35) (PointWise) [02/13/2023-19:53:47] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:53:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:53:47] [V] [TRT] *************** Autotuning format combination: Float(3,1:32,1,1), Float(6912,2304:32,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:53:47] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_34), Mul_35) (PointWiseV2) [02/13/2023-19:53:48] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0147954 [02/13/2023-19:53:48] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0151749 [02/13/2023-19:53:48] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0150702 [02/13/2023-19:53:49] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0148219 [02/13/2023-19:53:49] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0170768 [02/13/2023-19:53:49] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.0147954 [02/13/2023-19:53:49] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_34), Mul_35) (PointWise) [02/13/2023-19:53:49] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:53:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [02/13/2023-19:53:49] [V] [TRT] *************** Autotuning format combination: Float(1:4,1,1,1), Float(1:4,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:53:49] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_34), Mul_35) (PointWiseV2) [02/13/2023-19:53:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.620265 [02/13/2023-19:53:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.763648 [02/13/2023-19:53:50] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.744576 [02/13/2023-19:53:50] [V] [TRT] Tactic: 0x0000000000000003 Time: 1.09322 [02/13/2023-19:53:50] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.09085 [02/13/2023-19:53:51] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.808837 [02/13/2023-19:53:51] [V] [TRT] Tactic: 0x0000000000000006 Time: 1.61629 [02/13/2023-19:53:52] [V] [TRT] Tactic: 0x0000000000000007 Time: 1.36807 [02/13/2023-19:53:52] [V] [TRT] Tactic: 0x0000000000000008 Time: 1.48062 [02/13/2023-19:53:52] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.12192 [02/13/2023-19:53:53] [V] [TRT] Tactic: 0x000000000000000a Time: 0.623195 [02/13/2023-19:53:53] [V] [TRT] Tactic: 0x000000000000000b Time: 0.867922 [02/13/2023-19:53:53] [V] [TRT] Tactic: 0x000000000000000c Time: 0.749998 [02/13/2023-19:53:54] [V] [TRT] Tactic: 0x000000000000000d Time: 1.66435 [02/13/2023-19:53:54] [V] [TRT] Tactic: 0x000000000000000e Time: 1.54492 [02/13/2023-19:53:54] [V] [TRT] Tactic: 0x000000000000000f Time: 1.13987 [02/13/2023-19:53:55] [V] [TRT] Tactic: 0x0000000000000010 Time: 3.00784 [02/13/2023-19:53:55] [V] [TRT] Tactic: 0x0000000000000011 Time: 2.25023 [02/13/2023-19:53:55] [V] [TRT] Tactic: 0x0000000000000012 Time: 2.31949 [02/13/2023-19:53:56] [V] [TRT] Tactic: 0x0000000000000013 Time: 1.52838 [02/13/2023-19:53:56] [V] [TRT] Tactic: 0x0000000000000014 Time: 1.07616 [02/13/2023-19:53:56] [V] [TRT] Tactic: 0x0000000000000015 Time: 1.38984 [02/13/2023-19:53:57] [V] [TRT] Tactic: 0x0000000000000016 Time: 1.6984 [02/13/2023-19:53:57] [V] [TRT] Tactic: 0x0000000000000017 Time: 2.32332 [02/13/2023-19:53:57] [V] [TRT] Tactic: 0x000000000000001c Time: 0.101403 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000000001d Time: 0.097728 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.144379 [02/13/2023-19:53:58] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.097728 [02/13/2023-19:53:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [02/13/2023-19:53:58] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:58] [V] [TRT] *************** Autotuning format combination: Float(165888,2304,64,1) -> Float(92160,2304,64,1) *************** [02/13/2023-19:53:58] [V] [TRT] --------------- Timing Runner: Conv_36 (CudaDepthwiseConvolution) [02/13/2023-19:53:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:58] [V] [TRT] --------------- Timing Runner: Conv_36 (FusedConvActConvolution) [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.115899 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.097744 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.094608 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.101778 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.0891909 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.083184 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.0953166 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.0955063 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.0904846 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.0843817 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.09368 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.219648 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x00000000005effff Time: 0.0824411 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.0975657 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.079072 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.128544 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.0807177 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.116023 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.0851566 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.100651 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.101381 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.083424 [02/13/2023-19:53:58] [V] [TRT] Fastest Tactic: 0x00000000006bffff Time: 0.079072 [02/13/2023-19:53:58] [V] [TRT] --------------- Timing Runner: Conv_36 (CudnnConvolution) [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0753989 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.044904 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.14211 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x0000000000000004 Time: 2.57012 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.171872 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.07584 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0446606 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000000003a Time: 0.14312 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000000003c Time: 2.5594 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x000000000000003d Time: 0.173815 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0759909 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0763977 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.142926 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x0000000000000074 Time: 2.56469 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.17323 [02/13/2023-19:53:58] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.0446606 [02/13/2023-19:53:58] [V] [TRT] --------------- Timing Runner: Conv_36 (CublasConvolution) [02/13/2023-19:53:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:58] [V] [TRT] --------------- Timing Runner: Conv_36 (CaskConvolution) [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0923954 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0722011 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0601905 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0833234 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0497478 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.113358 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.171954 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0677516 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0599512 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.107401 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0904091 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0753874 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0947063 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0539794 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0789851 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0487101 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0758309 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0614278 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.108505 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0602286 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0714469 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0506971 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0629821 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0601021 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0912937 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.163173 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:53:58] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0599817 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0632975 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0891977 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:53:58] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0908183 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0563002 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.116638 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0640076 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0718309 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:53:58] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0908617 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0599528 [02/13/2023-19:53:58] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:53:58] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.100949 [02/13/2023-19:53:58] [V] [TRT] Fastest Tactic: 0x5d4d781b2e89fd83 Time: 0.0487101 [02/13/2023-19:53:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000039 [02/13/2023-19:53:58] [V] [TRT] *************** Autotuning format combination: Float(165888,1,4608,72) -> Float(92160,1,2560,40) *************** [02/13/2023-19:53:58] [V] [TRT] --------------- Timing Runner: Conv_36 (CublasConvolution) [02/13/2023-19:53:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:59] [V] [TRT] --------------- Timing Runner: Conv_36 (CaskConvolution) [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0716252 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0402469 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0833166 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0296905 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0601082 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.03648 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0534111 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0647985 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0637669 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0601051 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0403177 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0408206 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0292709 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0831291 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0498149 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0447303 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0407783 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0678339 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0485333 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.04416 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.081696 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0489996 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0447509 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0381371 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0440903 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.040888 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0565288 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0486537 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.048573 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0634331 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.071421 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0642316 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0524952 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0834103 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0800229 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0686217 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0554438 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0387611 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0823589 [02/13/2023-19:53:59] [V] [TRT] Fastest Tactic: 0x4ddd867d1da71041 Time: 0.0292709 [02/13/2023-19:53:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:59] [V] [TRT] *************** Autotuning format combination: Float(41472,1:4,1152,18) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:53:59] [V] [TRT] --------------- Timing Runner: Conv_36 (CublasConvolution) [02/13/2023-19:53:59] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:59] [V] [TRT] --------------- Timing Runner: Conv_36 (CaskConvolution) [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.040656 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0304942 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0364663 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0409177 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0407669 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0291474 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0515596 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0407691 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.067811 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0485196 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.04468 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0507672 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0381954 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0444811 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0409383 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0482895 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0492206 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0678446 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0547383 [02/13/2023-19:53:59] [V] [TRT] Conv_36 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0385189 [02/13/2023-19:53:59] [V] [TRT] Fastest Tactic: 0x4ddd867d1da71041 Time: 0.0291474 [02/13/2023-19:53:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:59] [V] [TRT] =============== Computing costs for [02/13/2023-19:53:59] [V] [TRT] *************** Autotuning format combination: Float(92160,2304,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:53:59] [V] [TRT] --------------- Timing Runner: Conv_37 + Relu_38 (CudaDepthwiseConvolution) [02/13/2023-19:53:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:59] [V] [TRT] --------------- Timing Runner: Conv_37 + Relu_38 (FusedConvActConvolution) [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.244873 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.304256 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.194373 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.300535 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.195296 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.189435 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.30128 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.185627 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.191698 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.188448 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.300498 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.31824 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x00000000005effff Time: 0.190651 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.201207 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.192594 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.227209 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.190528 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.200279 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.193838 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.200805 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.207785 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.1808 [02/13/2023-19:53:59] [V] [TRT] Fastest Tactic: 0x0000000000a3ffff Time: 0.1808 [02/13/2023-19:53:59] [V] [TRT] --------------- Timing Runner: Conv_37 + Relu_38 (CudnnConvolution) [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.131262 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.103438 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.174519 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x0000000000000004 Time: 4.51144 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.225774 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.130105 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.102048 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x000000000000003a Time: 0.172608 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x000000000000003c Time: 4.62788 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x000000000000003d Time: 0.251461 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.130201 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.130624 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.17611 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x0000000000000074 Time: 4.49088 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.150281 [02/13/2023-19:53:59] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.102048 [02/13/2023-19:53:59] [V] [TRT] --------------- Timing Runner: Conv_37 + Relu_38 (CublasConvolution) [02/13/2023-19:53:59] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:59] [V] [TRT] --------------- Timing Runner: Conv_37 + Relu_38 (CaskConvolution) [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0456377 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0493912 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0405234 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0610865 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0316736 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0553265 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0706865 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0452869 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0317065 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0666377 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0341979 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0367954 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0519314 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0596251 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.057315 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0524526 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.046576 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.050112 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0648762 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0374217 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.042912 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0389349 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0498712 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0373371 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0519695 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.082192 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0367017 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0404514 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0428229 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0534187 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0426846 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0843131 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.057117 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0718194 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0502324 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0463954 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0593539 [02/13/2023-19:53:59] [V] [TRT] Fastest Tactic: 0x1fc87d7eb370bb7a Time: 0.0316736 [02/13/2023-19:53:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:53:59] [V] [TRT] *************** Autotuning format combination: Float(92160,1,2560,40) -> Float(276480,1,7680,120) *************** [02/13/2023-19:53:59] [V] [TRT] --------------- Timing Runner: Conv_37 + Relu_38 (CublasConvolution) [02/13/2023-19:53:59] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:59] [V] [TRT] --------------- Timing Runner: Conv_37 + Relu_38 (CaskConvolution) [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.043264 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0291026 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0448709 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0378674 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0472 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0323867 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0421897 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.058781 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0583802 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0474709 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0356142 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0320613 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0356178 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0425954 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0351131 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0365109 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0290048 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0452571 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0322798 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.037928 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0423154 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0481128 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0355822 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0258949 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0390377 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0293815 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0456686 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xba269390692faead Time: 0.032565 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0325915 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.052 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0392697 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0583543 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0398126 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.042672 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0423463 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0450411 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0525867 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0356334 [02/13/2023-19:53:59] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:53:59] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0424823 [02/13/2023-19:53:59] [V] [TRT] Fastest Tactic: 0x9dece0dc37e90462 Time: 0.0258949 [02/13/2023-19:53:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9dece0dc37e90462 [02/13/2023-19:53:59] [V] [TRT] *************** Autotuning format combination: Float(23040,1:4,640,10) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:53:59] [V] [TRT] --------------- Timing Runner: Conv_37 + Relu_38 (CublasConvolution) [02/13/2023-19:53:59] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:53:59] [V] [TRT] --------------- Timing Runner: Conv_37 + Relu_38 (CaskConvolution) [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0265173 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.037 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.032256 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0356507 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0321161 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0354807 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0348041 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0288311 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0448206 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0323255 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0379326 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0487177 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0255802 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:00] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0391543 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:00] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0295991 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:00] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0324233 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0324114 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:00] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0453371 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:00] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0530377 [02/13/2023-19:54:00] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0310921 [02/13/2023-19:54:00] [V] [TRT] Fastest Tactic: 0x9dece0dc37e90462 Time: 0.0255802 [02/13/2023-19:54:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:00] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:00] [V] [TRT] *************** Autotuning format combination: Float(276480,2304,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:54:00] [V] [TRT] --------------- Timing Runner: Conv_39 + Relu_40 (CudaDepthwiseConvolution) [02/13/2023-19:54:00] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.0848777 [02/13/2023-19:54:00] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.0848777 [02/13/2023-19:54:00] [V] [TRT] --------------- Timing Runner: Conv_39 + Relu_40 (CudnnConvolution) [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.157134 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.156411 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.159666 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x0000000000000004 Time: 18.0977 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x0000000000000005 Time: 14.302 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.09744 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.098032 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0970286 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x000000000000003c Time: 14.6383 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x000000000000003d Time: 14.6221 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0986149 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0979109 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0977417 [02/13/2023-19:54:00] [V] [TRT] Tactic: 0x0000000000000074 Time: 14.6475 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000075 Time: 14.2947 [02/13/2023-19:54:01] [V] [TRT] Fastest Tactic: 0x000000000000003a Time: 0.0970286 [02/13/2023-19:54:01] [V] [TRT] --------------- Timing Runner: Conv_39 + Relu_40 (CaskConvolution) [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 2.28114 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 1.92251 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 2.81322 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 3.43929 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 3.20742 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 1.93632 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r5s5_aligna4_alignc4 Tactic: 0x967f94e9db2001a8 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x967f94e9db2001a8 Time: 1.7944 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:54:01] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 1.81332 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 1.61381 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 3.62297 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 2.09576 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:01] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 2.82587 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 2.05099 [02/13/2023-19:54:01] [V] [TRT] Fastest Tactic: 0xa8609adc4e0ceb90 Time: 1.61381 [02/13/2023-19:54:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 0xffffffffffffffff [02/13/2023-19:54:01] [V] [TRT] *************** Autotuning format combination: Float(276480,1,7680,120) -> Float(276480,1,7680,120) *************** [02/13/2023-19:54:01] [V] [TRT] --------------- Timing Runner: Conv_39 + Relu_40 (CaskConvolution) [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 4.42423 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 4.85555 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r5s5_aligna4_alignc4 Tactic: 0x45ff0c3a09b02e78 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x45ff0c3a09b02e78 Time: 3.92244 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf2 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x5030121339a48bf2 Time: 4.47585 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 4.07947 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 5.39984 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d739 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0xca7eeb8d9143d739 Time: 4.55076 [02/13/2023-19:54:01] [V] [TRT] Conv_39 + Relu_40 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf50 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0xd9031472c05adf50 Time: 4.5288 [02/13/2023-19:54:01] [V] [TRT] Fastest Tactic: 0x45ff0c3a09b02e78 Time: 3.92244 [02/13/2023-19:54:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x45ff0c3a09b02e78 [02/13/2023-19:54:01] [V] [TRT] *************** Autotuning format combination: Float(69120,1:4,1920,30) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:54:01] [V] [TRT] --------------- Timing Runner: Conv_39 + Relu_40 (CaskConvolution) [02/13/2023-19:54:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:01] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:01] [V] [TRT] *************** Autotuning format combination: Float(276480,2304,64,1) -> Float(120,1,1,1) *************** [02/13/2023-19:54:01] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_41 (TiledPooling) [02/13/2023-19:54:01] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [02/13/2023-19:54:01] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_41 (CudnnPooling) [02/13/2023-19:54:01] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.0121444 [02/13/2023-19:54:01] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.0121444 [02/13/2023-19:54:01] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_41 (CaskPooling) [02/13/2023-19:54:01] [V] [TRT] GlobalAveragePool_41 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Average_FastDiv Tactic: 0x933eceba7b866d59 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x933eceba7b866d59 Time: 0.0118333 [02/13/2023-19:54:01] [V] [TRT] Fastest Tactic: 0x933eceba7b866d59 Time: 0.0118333 [02/13/2023-19:54:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x933eceba7b866d59 [02/13/2023-19:54:01] [V] [TRT] *************** Autotuning format combination: Float(69120,1:4,1920,30) -> Float(30,1:4,30,30) *************** [02/13/2023-19:54:01] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_41 (CaskPooling) [02/13/2023-19:54:01] [V] [TRT] GlobalAveragePool_41 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Average_FastDiv_CAlign4 Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:54:01] [V] [TRT] Tactic: 0xfab3e2ee1c085a9a Time: 0.0111726 [02/13/2023-19:54:01] [V] [TRT] Fastest Tactic: 0xfab3e2ee1c085a9a Time: 0.0111726 [02/13/2023-19:54:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:54:01] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:01] [V] [TRT] *************** Autotuning format combination: Float(120,1,1,1) -> Float(32,1,1,1) *************** [02/13/2023-19:54:01] [V] [TRT] --------------- Timing Runner: Conv_42 + Relu_43 (CudaDepthwiseConvolution) [02/13/2023-19:54:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:01] [V] [TRT] --------------- Timing Runner: Conv_42 + Relu_43 (FusedConvActConvolution) [02/13/2023-19:54:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:01] [V] [TRT] --------------- Timing Runner: Conv_42 + Relu_43 (CudnnConvolution) [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0223785 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0159954 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0411269 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0974057 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.039048 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0222916 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0158893 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0418114 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x000000000000003c Time: 0.103591 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x000000000000003d Time: 0.0389874 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0221146 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.022161 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0413577 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000074 Time: 0.102466 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.0386777 [02/13/2023-19:54:01] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.0158893 [02/13/2023-19:54:01] [V] [TRT] --------------- Timing Runner: Conv_42 + Relu_43 (CublasConvolution) [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0111754 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0113136 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0113987 [02/13/2023-19:54:01] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0116227 [02/13/2023-19:54:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0111754 [02/13/2023-19:54:01] [V] [TRT] --------------- Timing Runner: Conv_42 + Relu_43 (CaskConvolution) [02/13/2023-19:54:01] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0157723 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.00906971 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.015013 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.00946486 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0137567 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0257859 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0351479 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0160879 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0243924 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0223491 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0287049 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0308654 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.022082 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.022336 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0166679 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0200663 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0137696 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0101501 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0243429 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0192389 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0285029 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0136033 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0204006 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0246575 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0195406 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.0344859 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0181446 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0258811 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.028821 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xaa0953b1a73b0b9b Time: 0.00566031 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0201423 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0226011 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0264869 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0205871 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0115415 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0287781 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0246842 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0539444 [02/13/2023-19:54:02] [V] [TRT] Fastest Tactic: 0xaa0953b1a73b0b9b Time: 0.00566031 [02/13/2023-19:54:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:02] [V] [TRT] *************** Autotuning format combination: Float(120,1,120,120) -> Float(32,1,32,32) *************** [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: Conv_42 + Relu_43 (CublasConvolution) [02/13/2023-19:54:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: Conv_42 + Relu_43 (CaskConvolution) [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0178159 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0118748 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0266926 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0118787 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0201234 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.00937143 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0178937 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0139599 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0140671 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.020164 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00729463 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.00928857 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.011622 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0266804 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0117827 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0117918 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0162022 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0160335 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.00952533 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.00985631 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.026717 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.00720087 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0117957 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0118435 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.00763717 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0164368 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0184166 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xba269390692faead Time: 0.00934429 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0116856 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0284739 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0164277 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0139516 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0163449 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.026909 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0266933 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0162001 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.00725851 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.00973349 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0266027 [02/13/2023-19:54:02] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.00720087 [02/13/2023-19:54:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:54:02] [V] [TRT] *************** Autotuning format combination: Float(30,1:4,30,30) -> Float(8,1:4,8,8) *************** [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: Conv_42 + Relu_43 (CublasConvolution) [02/13/2023-19:54:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: Conv_42 + Relu_43 (CaskConvolution) [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0119044 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0119128 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.00933314 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00750308 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.00931114 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0116382 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0118502 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0161605 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0159655 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.00941171 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.00958659 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0071101 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0118038 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.00750926 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0162885 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xba269390692faead Time: 0.00934857 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0119665 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0161123 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.00724046 [02/13/2023-19:54:02] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.00962865 [02/13/2023-19:54:02] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.0071101 [02/13/2023-19:54:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:54:02] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:02] [V] [TRT] *************** Autotuning format combination: Float(32,1,1,1) -> Float(120,1,1,1) *************** [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: Conv_44 (CudaDepthwiseConvolution) [02/13/2023-19:54:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: Conv_44 (FusedConvActConvolution) [02/13/2023-19:54:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: Conv_44 (CudnnConvolution) [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0128015 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0128716 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0176279 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.111374 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0342098 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0128297 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0128255 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0179491 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x000000000000003c Time: 0.105559 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x000000000000003d Time: 0.034325 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0128038 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0128152 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0175263 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000074 Time: 0.11195 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.0342354 [02/13/2023-19:54:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0128015 [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: Conv_44 (CublasConvolution) [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.011028 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0110453 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0111972 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0111634 [02/13/2023-19:54:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.011028 [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: Conv_44 (CaskConvolution) [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0118762 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0075532 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0114912 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.00913286 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.00928171 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0182097 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.020418 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0121714 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0139524 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0187697 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0158903 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0224856 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0159695 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.016125 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0141149 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0141461 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.00987794 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.00938571 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0180029 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0157403 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.020348 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.00914057 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0133631 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.013777 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.011712 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.0200789 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0139154 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0140093 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0156293 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xaa0953b1a73b0b9b Time: 0.00599048 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0123242 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0138851 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0183777 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0137085 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.01008 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0159436 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0139782 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0265448 [02/13/2023-19:54:02] [V] [TRT] Fastest Tactic: 0xaa0953b1a73b0b9b Time: 0.00599048 [02/13/2023-19:54:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:02] [V] [TRT] *************** Autotuning format combination: Float(32,1,32,32) -> Float(120,1,120,120) *************** [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: Conv_44 (CublasConvolution) [02/13/2023-19:54:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: Conv_44 (CaskConvolution) [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0114848 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.00906857 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0136628 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.00962012 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0116005 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.00741166 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0117721 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.00977432 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.00979566 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0116403 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00741669 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.00793023 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.00907 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0138589 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.00933457 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.00919057 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.011482 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0113104 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0072016 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.00926314 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0138793 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.00710313 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.00890272 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.00916571 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.00743109 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0117187 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0115548 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xba269390692faead Time: 0.00738971 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.00898686 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0178397 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0112672 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.00976792 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0115228 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0139512 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0139059 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0115794 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.00711053 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0078963 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0136661 [02/13/2023-19:54:02] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.00710313 [02/13/2023-19:54:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:54:02] [V] [TRT] *************** Autotuning format combination: Float(8,1:4,8,8) -> Float(30,1:4,30,30) *************** [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: Conv_44 (CublasConvolution) [02/13/2023-19:54:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: Conv_44 (CaskConvolution) [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.00902943 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.00957592 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.00739131 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00714377 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.00800483 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.00911543 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.00911686 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0115464 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0114623 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.00725029 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.00935228 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.00693703 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.00907371 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.00737531 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0116649 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xba269390692faead Time: 0.00729006 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.008972 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0115087 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.00718903 [02/13/2023-19:54:02] [V] [TRT] Conv_44 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.00799111 [02/13/2023-19:54:02] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.00693703 [02/13/2023-19:54:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:54:02] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:02] [V] [TRT] *************** Autotuning format combination: Float(120,1,1,1), Float(276480,2304,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_45), Mul_46) (PointWiseV2) [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207347 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0151954 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0139749 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0178001 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0175792 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0165486 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0224392 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.021664 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0215824 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0206988 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0207582 [02/13/2023-19:54:02] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.0139749 [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_45), Mul_46) (PointWise) [02/13/2023-19:54:02] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [02/13/2023-19:54:02] [V] [TRT] *************** Autotuning format combination: Float(120,1,120,120), Float(276480,1,7680,120) -> Float(276480,1,7680,120) *************** [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_45), Mul_46) (PointWiseV2) [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0255604 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0184794 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0165917 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0153403 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0133935 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.012331 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.020044 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0153842 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0147369 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0154405 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0250659 [02/13/2023-19:54:02] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.012331 [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_45), Mul_46) (PointWise) [02/13/2023-19:54:02] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:54:02] [V] [TRT] *************** Autotuning format combination: Float(30,1:4,30,30), Float(69120,1:4,1920,30) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:54:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_45), Mul_46) (PointWiseV2) [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207229 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0193869 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0226658 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0225358 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0204709 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0195526 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0232797 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0226024 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0200006 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0223242 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0199017 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0183377 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0189577 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0210736 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0206302 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0195446 [02/13/2023-19:54:02] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0188943 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0226018 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0208764 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0190794 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0272213 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0192794 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0145563 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0175477 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0202966 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000001d Time: 0.01806 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0254423 [02/13/2023-19:54:03] [V] [TRT] Fastest Tactic: 0x0000000000000016 Time: 0.0145563 [02/13/2023-19:54:03] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_45), Mul_46) (PointWise) [02/13/2023-19:54:03] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000016 [02/13/2023-19:54:03] [V] [TRT] *************** Autotuning format combination: Float(4,1:32,1,1), Float(9216,2304:32,64,1) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:54:03] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_45), Mul_46) (PointWiseV2) [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0199097 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0210312 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0205956 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0186017 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000001f Time: 0.018624 [02/13/2023-19:54:03] [V] [TRT] Fastest Tactic: 0x000000000000001b Time: 0.0186017 [02/13/2023-19:54:03] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_45), Mul_46) (PointWise) [02/13/2023-19:54:03] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001b [02/13/2023-19:54:03] [V] [TRT] *************** Autotuning format combination: Float(1:4,1,1,1), Float(1:4,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:54:03] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_45), Mul_46) (PointWiseV2) [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.881518 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 1.08567 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000002 Time: 1.0588 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000003 Time: 1.42477 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.41487 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.04778 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000006 Time: 2.10086 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000007 Time: 1.77956 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000008 Time: 1.90411 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.46864 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000000a Time: 0.806779 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000000b Time: 1.01804 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000000c Time: 0.875977 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000000d Time: 1.27096 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000000e Time: 1.21013 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000000f Time: 0.891067 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000010 Time: 1.78779 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000011 Time: 1.4708 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000012 Time: 1.52614 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000013 Time: 1.00817 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.709737 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.912005 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000016 Time: 1.11152 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000017 Time: 1.51823 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0712031 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0666286 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000001e Time: 0.096016 [02/13/2023-19:54:03] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.0666286 [02/13/2023-19:54:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [02/13/2023-19:54:03] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:03] [V] [TRT] *************** Autotuning format combination: Float(276480,2304,64,1), Float(92160,2304,64,1) -> Float(92160,2304,64,1) *************** [02/13/2023-19:54:03] [V] [TRT] --------------- Timing Runner: Conv_47 + Add_48 (CudaDepthwiseConvolution) [02/13/2023-19:54:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:03] [V] [TRT] --------------- Timing Runner: Conv_47 + Add_48 (FusedConvActConvolution) [02/13/2023-19:54:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:03] [V] [TRT] --------------- Timing Runner: Conv_47 + Add_48 (CudnnConvolution) [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0460434 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0289929 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.125893 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000004 Time: 2.27539 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.117134 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0468549 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0288027 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0879337 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000003c Time: 2.16714 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x000000000000003d Time: 0.115042 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0466789 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0460274 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.087456 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000074 Time: 2.26001 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.122427 [02/13/2023-19:54:03] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.0288027 [02/13/2023-19:54:03] [V] [TRT] --------------- Timing Runner: Conv_47 + Add_48 (CublasConvolution) [02/13/2023-19:54:03] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:03] [V] [TRT] --------------- Timing Runner: Conv_47 + Add_48 (CaskConvolution) [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0435349 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0310418 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0309632 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0368343 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.028832 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0649356 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.109067 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0348306 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0351936 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0460217 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0530149 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0415737 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0585676 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0265387 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0352128 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.024576 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0413703 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0275139 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.063136 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0336841 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0401177 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0285751 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0352576 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0350811 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0501044 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.100489 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0330898 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0373211 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.052067 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0524769 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0310629 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0669455 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0353207 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0309422 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0536122 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0351954 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.062944 [02/13/2023-19:54:03] [V] [TRT] Fastest Tactic: 0x5d4d781b2e89fd83 Time: 0.024576 [02/13/2023-19:54:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:03] [V] [TRT] *************** Autotuning format combination: Float(276480,1,7680,120), Float(92160,1,2560,40) -> Float(92160,1,2560,40) *************** [02/13/2023-19:54:03] [V] [TRT] --------------- Timing Runner: Conv_47 + Add_48 (CublasConvolution) [02/13/2023-19:54:03] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:03] [V] [TRT] --------------- Timing Runner: Conv_47 + Add_48 (CaskConvolution) [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0396686 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0211657 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0491474 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0156553 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0346651 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0181429 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0307685 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0322469 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0319854 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0348901 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0182554 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0181966 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0145591 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0499337 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.024656 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0246568 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0200389 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0332014 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0246575 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0202989 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0486735 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0226789 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0246682 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0208353 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0191594 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0203446 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.031136 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0245775 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.024621 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0387349 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0395543 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0310491 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0289271 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0496076 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0478674 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0343543 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0243451 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0201526 [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:03] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0481402 [02/13/2023-19:54:03] [V] [TRT] Fastest Tactic: 0x4ddd867d1da71041 Time: 0.0145591 [02/13/2023-19:54:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:03] [V] [TRT] *************** Autotuning format combination: Float(69120,1:4,1920,30), Float(23040,1:4,640,10) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:54:03] [V] [TRT] --------------- Timing Runner: Conv_47 + Add_48 (CublasConvolution) [02/13/2023-19:54:03] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:03] [V] [TRT] --------------- Timing Runner: Conv_47 + Add_48 (CaskConvolution) [02/13/2023-19:54:03] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0211331 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.015723 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0181931 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0182046 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.018236 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0144174 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0245128 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0202891 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0333413 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0246164 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0199857 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0225437 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0209476 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0193971 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0202857 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0244998 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0245928 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0344457 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0244015 [02/13/2023-19:54:04] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0198669 [02/13/2023-19:54:04] [V] [TRT] Fastest Tactic: 0x4ddd867d1da71041 Time: 0.0144174 [02/13/2023-19:54:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:04] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(92160,2304,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(92160,1,2560,40) -> Float(276480,1,7680,120) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(23040,1:4,640,10) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:54:04] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(276480,2304,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(276480,1,7680,120) -> Float(276480,1,7680,120) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(69120,1:4,1920,30) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:54:04] [V] [TRT] --------------- Timing Runner: Conv_51 + Relu_52 (CaskConvolution) [02/13/2023-19:54:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:04] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(276480,2304,64,1) -> Float(120,1,1,1) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(69120,1:4,1920,30) -> Float(30,1:4,30,30) *************** [02/13/2023-19:54:04] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(120,1,1,1) -> Float(32,1,1,1) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(120,1,120,120) -> Float(32,1,32,32) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(30,1:4,30,30) -> Float(8,1:4,8,8) *************** [02/13/2023-19:54:04] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(32,1,1,1) -> Float(120,1,1,1) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(32,1,32,32) -> Float(120,1,120,120) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(8,1:4,8,8) -> Float(30,1:4,30,30) *************** [02/13/2023-19:54:04] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(120,1,1,1), Float(276480,2304,64,1) -> Float(276480,2304,64,1) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(120,1,120,120), Float(276480,1,7680,120) -> Float(276480,1,7680,120) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(30,1:4,30,30), Float(69120,1:4,1920,30) -> Float(69120,1:4,1920,30) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(4,1:32,1,1), Float(9216,2304:32,64,1) -> Float(9216,2304:32,64,1) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(1:4,1,1,1), Float(1:4,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:54:04] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(276480,2304,64,1), Float(92160,2304,64,1) -> Float(92160,2304,64,1) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(276480,1,7680,120), Float(92160,1,2560,40) -> Float(92160,1,2560,40) *************** [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(69120,1:4,1920,30), Float(23040,1:4,640,10) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:54:04] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(92160,2304,64,1) -> Float(552960,2304,64,1) *************** [02/13/2023-19:54:04] [V] [TRT] --------------- Timing Runner: Conv_61 (CudaDepthwiseConvolution) [02/13/2023-19:54:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:04] [V] [TRT] --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.154203 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.233221 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.148521 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.223749 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.131941 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.13187 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.232288 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.138446 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.136549 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.139067 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.22549 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.234405 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x00000000005effff Time: 0.15109 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.146537 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.1364 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.170487 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.146478 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.149152 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.133506 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.138064 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.145458 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.145326 [02/13/2023-19:54:04] [V] [TRT] Fastest Tactic: 0x000000000035ffff Time: 0.13187 [02/13/2023-19:54:04] [V] [TRT] --------------- Timing Runner: Conv_61 (CudnnConvolution) [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0710156 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0481509 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.087872 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x0000000000000004 Time: 5.10417 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.161728 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0707048 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0488823 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x000000000000003a Time: 0.090528 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x000000000000003c Time: 4.99021 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x000000000000003d Time: 0.160955 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0705112 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0635764 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0886834 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x0000000000000074 Time: 5.06781 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.163717 [02/13/2023-19:54:04] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0481509 [02/13/2023-19:54:04] [V] [TRT] --------------- Timing Runner: Conv_61 (CublasConvolution) [02/13/2023-19:54:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:04] [V] [TRT] --------------- Timing Runner: Conv_61 (CaskConvolution) [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0541912 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0708785 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0476678 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0874377 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0407634 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.043376 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.055779 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0550461 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0353673 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0855451 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0385966 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0529752 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0506042 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0520457 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0562316 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0460617 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0441074 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0536488 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0587413 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0378651 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0487589 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.039488 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0442 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0356754 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0452663 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.0523276 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0342629 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0370194 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0376469 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0440331 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0340663 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0451006 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0476541 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0644998 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0383634 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0360503 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0567954 [02/13/2023-19:54:04] [V] [TRT] Fastest Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0340663 [02/13/2023-19:54:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:04] [V] [TRT] *************** Autotuning format combination: Float(92160,1,2560,40) -> Float(552960,1,15360,240) *************** [02/13/2023-19:54:04] [V] [TRT] --------------- Timing Runner: Conv_61 (CublasConvolution) [02/13/2023-19:54:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:04] [V] [TRT] --------------- Timing Runner: Conv_61 (CaskConvolution) [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0353234 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0228682 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0333961 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0288805 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.038832 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.026637 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0357429 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0544914 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0557577 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0390971 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0318848 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.027747 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.026877 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0336247 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0266156 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0332763 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0288137 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0285227 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0278194 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0354962 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0335003 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0476312 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.032224 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0223752 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0358343 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0301623 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.037384 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xba269390692faead Time: 0.026739 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0265425 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0439897 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0343497 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:04] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0535162 [02/13/2023-19:54:04] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0345783 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.034112 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0331502 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0295899 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0533455 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.030027 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0339785 [02/13/2023-19:54:05] [V] [TRT] Fastest Tactic: 0x9dece0dc37e90462 Time: 0.0223752 [02/13/2023-19:54:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:05] [V] [TRT] *************** Autotuning format combination: Float(23040,1:4,640,10) -> Float(138240,1:4,3840,60) *************** [02/13/2023-19:54:05] [V] [TRT] --------------- Timing Runner: Conv_61 (CublasConvolution) [02/13/2023-19:54:05] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:05] [V] [TRT] --------------- Timing Runner: Conv_61 (CaskConvolution) [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0225051 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0289737 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0265874 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0319049 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0279139 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0268373 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0264998 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0287269 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0291392 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0279375 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.032085 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0474183 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0223752 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.035832 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0302638 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0274004 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.026509 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0296795 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0537829 [02/13/2023-19:54:05] [V] [TRT] Conv_61 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.030048 [02/13/2023-19:54:05] [V] [TRT] Fastest Tactic: 0x9dece0dc37e90462 Time: 0.0223752 [02/13/2023-19:54:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:05] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:05] [V] [TRT] *************** Autotuning format combination: Float(552960,2304,64,1) -> Float(552960,2304,64,1) *************** [02/13/2023-19:54:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_62), Mul_63) (PointWiseV2) [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0304887 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0249783 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0230067 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0211722 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.024813 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0254682 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0261737 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0265204 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0251535 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.021442 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0311781 [02/13/2023-19:54:05] [V] [TRT] Fastest Tactic: 0x0000000000000003 Time: 0.0211722 [02/13/2023-19:54:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_62), Mul_63) (PointWise) [02/13/2023-19:54:05] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000003 [02/13/2023-19:54:05] [V] [TRT] *************** Autotuning format combination: Float(552960,1,15360,240) -> Float(552960,1,15360,240) *************** [02/13/2023-19:54:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_62), Mul_63) (PointWiseV2) [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0314999 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0265897 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0258278 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0274781 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.024915 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.024355 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0249067 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0252472 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0255726 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0254926 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0299767 [02/13/2023-19:54:05] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.024355 [02/13/2023-19:54:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_62), Mul_63) (PointWise) [02/13/2023-19:54:05] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:54:05] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,3840,60) -> Float(138240,1:4,3840,60) *************** [02/13/2023-19:54:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_62), Mul_63) (PointWiseV2) [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023633 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0228722 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0245089 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.024995 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0253013 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0254331 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0253448 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0227383 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0253539 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0236676 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0239947 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0239451 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0242545 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0236317 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0229061 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0239276 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0239444 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0253181 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0236963 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0222962 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0309111 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0268777 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.025933 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0251909 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0237414 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0249966 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0317797 [02/13/2023-19:54:05] [V] [TRT] Fastest Tactic: 0x0000000000000013 Time: 0.0222962 [02/13/2023-19:54:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_62), Mul_63) (PointWise) [02/13/2023-19:54:05] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000013 [02/13/2023-19:54:05] [V] [TRT] *************** Autotuning format combination: Float(18432,2304:32,64,1) -> Float(18432,2304:32,64,1) *************** [02/13/2023-19:54:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_62), Mul_63) (PointWiseV2) [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0251718 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0275848 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0260945 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0270171 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000001f Time: 0.024899 [02/13/2023-19:54:05] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.024899 [02/13/2023-19:54:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_62), Mul_63) (PointWise) [02/13/2023-19:54:05] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [02/13/2023-19:54:05] [V] [TRT] *************** Autotuning format combination: Float(1:4,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:54:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_62), Mul_63) (PointWiseV2) [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.05611 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000001 Time: 1.34199 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000002 Time: 1.30909 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000003 Time: 1.87645 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.72211 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.24983 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000006 Time: 2.96564 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000007 Time: 2.2015 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000008 Time: 1.8428 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.94802 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000000a Time: 1.01807 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000000b Time: 1.23135 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000000c Time: 1.15094 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000000d Time: 1.58748 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000000e Time: 1.52789 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000000f Time: 1.13698 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000010 Time: 2.31598 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000011 Time: 1.9832 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000012 Time: 1.63435 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000013 Time: 1.40672 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.932878 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000015 Time: 1.19526 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000016 Time: 1.55522 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000017 Time: 2.30911 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0983497 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000001d Time: 0.100293 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x000000000000001e Time: 0.133207 [02/13/2023-19:54:05] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0983497 [02/13/2023-19:54:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:54:05] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:05] [V] [TRT] *************** Autotuning format combination: Float(552960,2304,64,1) -> Float(138240,576,32,1) *************** [02/13/2023-19:54:05] [V] [TRT] --------------- Timing Runner: Conv_64 (CudaDepthwiseConvolution) [02/13/2023-19:54:05] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.0204264 [02/13/2023-19:54:05] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.0204264 [02/13/2023-19:54:05] [V] [TRT] --------------- Timing Runner: Conv_64 (CudnnConvolution) [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0298578 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0297737 [02/13/2023-19:54:05] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0298231 [02/13/2023-19:54:06] [V] [TRT] Tactic: 0x0000000000000005 Time: 24.7301 [02/13/2023-19:54:06] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.029696 [02/13/2023-19:54:06] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.030037 [02/13/2023-19:54:06] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0297253 [02/13/2023-19:54:06] [V] [TRT] Tactic: 0x000000000000003d Time: 24.6431 [02/13/2023-19:54:06] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0301275 [02/13/2023-19:54:06] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0351525 [02/13/2023-19:54:06] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0301577 [02/13/2023-19:54:06] [V] [TRT] Tactic: 0x0000000000000075 Time: 24.6642 [02/13/2023-19:54:06] [V] [TRT] Fastest Tactic: 0x0000000000000038 Time: 0.029696 [02/13/2023-19:54:06] [V] [TRT] --------------- Timing Runner: Conv_64 (CaskConvolution) [02/13/2023-19:54:06] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:54:06] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 2.74993 [02/13/2023-19:54:06] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:54:06] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 2.95745 [02/13/2023-19:54:06] [V] [TRT] Conv_64 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:06] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 2.71387 [02/13/2023-19:54:06] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:54:06] [V] [TRT] Tactic: 0x4727434768e46395 Time: 1.81248 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:54:07] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 5.61177 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:07] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 3.10965 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 3.11812 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 2.7737 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 2.77893 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:54:07] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 1.93835 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 2.61418 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 5.7899 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 2.1816 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:07] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 3.36155 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 2.76817 [02/13/2023-19:54:07] [V] [TRT] Fastest Tactic: 0x4727434768e46395 Time: 1.81248 [02/13/2023-19:54:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 0xffffffffffffffff [02/13/2023-19:54:07] [V] [TRT] *************** Autotuning format combination: Float(552960,1,15360,240) -> Float(138240,1,7680,240) *************** [02/13/2023-19:54:07] [V] [TRT] --------------- Timing Runner: Conv_64 (CaskConvolution) [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 2.68775 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 3.74125 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 6.70025 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf2 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0x5030121339a48bf2 Time: 0.999223 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:54:07] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 2.66725 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 6.4804 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 2.5852 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d739 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0xca7eeb8d9143d739 Time: 1.01786 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 3.60927 [02/13/2023-19:54:07] [V] [TRT] Conv_64 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf50 [02/13/2023-19:54:07] [V] [TRT] Tactic: 0xd9031472c05adf50 Time: 1.00682 [02/13/2023-19:54:08] [V] [TRT] Conv_64 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 3.67915 [02/13/2023-19:54:08] [V] [TRT] Fastest Tactic: 0x5030121339a48bf2 Time: 0.999223 [02/13/2023-19:54:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5030121339a48bf2 [02/13/2023-19:54:08] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,3840,60) -> Float(34560,1:4,1920,60) *************** [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: Conv_64 (CaskConvolution) [02/13/2023-19:54:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:08] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:08] [V] [TRT] *************** Autotuning format combination: Float(138240,576,32,1) -> Float(138240,576,32,1) *************** [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_65), Mul_66) (PointWiseV2) [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00899114 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00724229 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00713404 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00701344 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00688261 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00663169 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00686062 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00695118 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0068689 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00669984 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00804495 [02/13/2023-19:54:08] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00663169 [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_65), Mul_66) (PointWise) [02/13/2023-19:54:08] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:54:08] [V] [TRT] *************** Autotuning format combination: Float(138240,1,7680,240) -> Float(138240,1,7680,240) *************** [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_65), Mul_66) (PointWiseV2) [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00913429 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00721714 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00704718 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00711097 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00684539 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00664686 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00701888 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00689175 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0069231 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00678275 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00808864 [02/13/2023-19:54:08] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00664686 [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_65), Mul_66) (PointWise) [02/13/2023-19:54:08] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:54:08] [V] [TRT] *************** Autotuning format combination: Float(34560,1:4,1920,60) -> Float(34560,1:4,1920,60) *************** [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_65), Mul_66) (PointWiseV2) [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00659615 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00670795 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0066159 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00687478 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00690721 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00688653 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00700909 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0069575 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00713078 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00714491 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00718286 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000000b Time: 0.006912 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00676509 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00694313 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00697513 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00689459 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00692354 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00692027 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00680751 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00686759 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00937114 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00762562 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00716343 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00706046 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00662275 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00704087 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000001e Time: 0.009282 [02/13/2023-19:54:08] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00659615 [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_65), Mul_66) (PointWise) [02/13/2023-19:54:08] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [02/13/2023-19:54:08] [V] [TRT] *************** Autotuning format combination: Float(4608,576:32,32,1) -> Float(4608,576:32,32,1) *************** [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_65), Mul_66) (PointWiseV2) [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00720069 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00709769 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00708201 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00714253 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0070905 [02/13/2023-19:54:08] [V] [TRT] Fastest Tactic: 0x000000000000001a Time: 0.00708201 [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_65), Mul_66) (PointWise) [02/13/2023-19:54:08] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001a [02/13/2023-19:54:08] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_65), Mul_66) (PointWiseV2) [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.261911 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.338624 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.330971 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.472375 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.432645 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.306907 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.744782 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.553056 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.455822 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.457248 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000000a Time: 0.250496 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000000b Time: 0.309618 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000000c Time: 0.285998 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000000d Time: 0.400343 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000000e Time: 0.383886 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000000f Time: 0.280265 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.583195 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.496494 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.409554 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.339621 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.230473 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.300123 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.391607 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.580965 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0211337 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0252236 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0350738 [02/13/2023-19:54:08] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0211337 [02/13/2023-19:54:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:54:08] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:08] [V] [TRT] *************** Autotuning format combination: Float(138240,576,32,1) -> Float(46080,576,32,1) *************** [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: Conv_67 (CudaDepthwiseConvolution) [02/13/2023-19:54:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: Conv_67 (FusedConvActConvolution) [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.0787703 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.0518415 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.0357541 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.0389691 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000011ffff Time: 0.0334043 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.0373543 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.0312055 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.0499078 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000003cffff Time: 0.0363006 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.0354862 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000045ffff Time: 0.031029 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000046ffff Time: 0.0350665 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000004affff Time: 0.0354999 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.0374514 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000004effff Time: 0.0359246 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.0350711 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000051ffff Time: 0.0429657 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.039696 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.0857623 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000059ffff Time: 0.0343579 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000005effff Time: 0.0331127 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000005fffff Time: 0.0333513 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.0396446 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.031339 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.0607528 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.0370789 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000006fffff Time: 0.0386949 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.0480945 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.0328055 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.0372423 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.0394423 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000091ffff Time: 0.0352704 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x00000000009dffff Time: 0.0330295 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.0328951 [02/13/2023-19:54:08] [V] [TRT] Fastest Tactic: 0x000000000045ffff Time: 0.031029 [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: Conv_67 (CudnnConvolution) [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0323063 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0320722 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.112197 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.08536 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.15792 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0328942 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0323301 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000003a Time: 0.11243 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000003c Time: 1.08607 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x000000000000003d Time: 0.178254 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0324178 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.03264 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.11224 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000074 Time: 1.09147 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.174066 [02/13/2023-19:54:08] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0320722 [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: Conv_67 (CublasConvolution) [02/13/2023-19:54:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: Conv_67 (CaskConvolution) [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0200766 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0204257 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0202731 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0224157 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0329189 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0373623 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0576716 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0221675 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0391017 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0288283 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0478949 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0436126 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0308681 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0310793 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0226776 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0288201 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0181057 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0242309 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0331054 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0266377 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0415531 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0328539 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0327387 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.043656 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0309047 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.0562941 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0247215 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0456709 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0476861 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0311406 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0373371 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0378937 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0330167 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0266354 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0479939 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0394194 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.093536 [02/13/2023-19:54:08] [V] [TRT] Fastest Tactic: 0x5f5015dbf902f0a3 Time: 0.0181057 [02/13/2023-19:54:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:08] [V] [TRT] *************** Autotuning format combination: Float(138240,1,7680,240) -> Float(46080,1,2560,80) *************** [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: Conv_67 (CublasConvolution) [02/13/2023-19:54:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: Conv_67 (CaskConvolution) [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0278392 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0182526 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0474491 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0183131 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0308197 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0130593 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0285272 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0218808 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0222929 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0313646 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0159756 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0123147 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.018088 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0478126 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0164846 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0286875 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0247406 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0244541 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0132318 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0139894 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0456914 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0141361 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0287552 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0182646 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.016381 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0248724 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0287525 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0129764 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0161839 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0479116 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0267573 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0207393 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0268236 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.047368 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.045864 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0245257 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0158368 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0138888 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0452731 [02/13/2023-19:54:08] [V] [TRT] Fastest Tactic: 0x4aa9c14ea2943ef0 Time: 0.0123147 [02/13/2023-19:54:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:08] [V] [TRT] *************** Autotuning format combination: Float(34560,1:4,1920,60) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: Conv_67 (CublasConvolution) [02/13/2023-19:54:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:08] [V] [TRT] --------------- Timing Runner: Conv_67 (CaskConvolution) [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0182966 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0183697 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.013115 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.016 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0124663 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0181469 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0168305 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0245836 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0244427 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0134774 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0137214 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0140999 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:08] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0181669 [02/13/2023-19:54:08] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:08] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.01648 [02/13/2023-19:54:09] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0250766 [02/13/2023-19:54:09] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0129585 [02/13/2023-19:54:09] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0162337 [02/13/2023-19:54:09] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0246072 [02/13/2023-19:54:09] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0155483 [02/13/2023-19:54:09] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0138448 [02/13/2023-19:54:09] [V] [TRT] Fastest Tactic: 0x4aa9c14ea2943ef0 Time: 0.0124663 [02/13/2023-19:54:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:09] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:09] [V] [TRT] *************** Autotuning format combination: Float(46080,576,32,1) -> Float(115200,576,32,1) *************** [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: Conv_68 (CudaDepthwiseConvolution) [02/13/2023-19:54:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: Conv_68 (FusedConvActConvolution) [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.0538514 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.0399326 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.0438286 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.0402971 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000011ffff Time: 0.0403234 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.041096 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.0391383 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.0417589 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000003cffff Time: 0.0414526 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.0444903 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000045ffff Time: 0.0390457 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000046ffff Time: 0.0393474 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000004affff Time: 0.0414057 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.0456994 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000004effff Time: 0.042632 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.0413211 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000051ffff Time: 0.0458423 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.0394354 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.073344 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000059ffff Time: 0.0396183 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000005effff Time: 0.0407543 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000005fffff Time: 0.0404217 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.045832 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.0415463 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.0589044 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.0410891 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000006fffff Time: 0.0417017 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.0519345 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.0432411 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.0436903 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.0443806 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000091ffff Time: 0.0413051 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x00000000009dffff Time: 0.0416994 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.039952 [02/13/2023-19:54:09] [V] [TRT] Fastest Tactic: 0x000000000045ffff Time: 0.0390457 [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: Conv_68 (CudnnConvolution) [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0318866 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0193657 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.061347 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.977801 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.124898 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0316965 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.019292 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0611002 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000003c Time: 0.959598 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000003d Time: 0.120514 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0316142 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.031872 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0614293 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000074 Time: 0.978779 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.114843 [02/13/2023-19:54:09] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.019292 [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: Conv_68 (CublasConvolution) [02/13/2023-19:54:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: Conv_68 (CaskConvolution) [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0267337 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.024544 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0246149 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0288503 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0222903 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.026579 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0310281 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0279596 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0264853 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0434263 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0243589 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0309093 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.022434 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0225221 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0313737 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0203389 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0225078 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0246507 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0244914 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0187274 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0288183 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0225078 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0267756 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0255665 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0260968 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.0290834 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0181566 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.026813 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0233293 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0264861 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0242568 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0267086 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0270674 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0288667 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0243383 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0266568 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0437143 [02/13/2023-19:54:09] [V] [TRT] Fastest Tactic: 0xa419b3b68f2da07b Time: 0.0181566 [02/13/2023-19:54:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:09] [V] [TRT] *************** Autotuning format combination: Float(46080,1,2560,80) -> Float(115200,1,6400,200) *************** [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: Conv_68 (CublasConvolution) [02/13/2023-19:54:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: Conv_68 (CaskConvolution) [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.023232 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0134907 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0226344 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0139188 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0245973 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0143753 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0227455 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0266811 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0266339 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.024557 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0162717 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0160396 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0133187 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0225136 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0135489 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0201337 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0181143 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.017794 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0157989 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.018104 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0223164 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0181891 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.020204 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0126472 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0180063 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0180549 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0225731 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0143607 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0135655 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0267352 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0224242 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0264518 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0225776 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0225678 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0224503 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0177925 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0199103 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0158867 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0223745 [02/13/2023-19:54:09] [V] [TRT] Fastest Tactic: 0x9dece0dc37e90462 Time: 0.0126472 [02/13/2023-19:54:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:09] [V] [TRT] *************** Autotuning format combination: Float(11520,1:4,640,20) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: Conv_68 (CublasConvolution) [02/13/2023-19:54:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: Conv_68 (CaskConvolution) [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0132335 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0138215 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0140305 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0161473 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0160508 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0133702 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0137475 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0181714 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0177524 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0157947 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0178971 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0180503 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.012347 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0180114 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0182531 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0151899 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0131973 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0179543 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0196789 [02/13/2023-19:54:09] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.015966 [02/13/2023-19:54:09] [V] [TRT] Fastest Tactic: 0x9dece0dc37e90462 Time: 0.012347 [02/13/2023-19:54:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:09] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:09] [V] [TRT] *************** Autotuning format combination: Float(115200,576,32,1) -> Float(115200,576,32,1) *************** [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_69), Mul_70) (PointWiseV2) [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00760999 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00704936 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00675699 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0069969 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00658992 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00573385 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00669174 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00641928 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00659616 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00569125 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00766436 [02/13/2023-19:54:09] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.00569125 [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_69), Mul_70) (PointWise) [02/13/2023-19:54:09] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [02/13/2023-19:54:09] [V] [TRT] *************** Autotuning format combination: Float(115200,1,6400,200) -> Float(115200,1,6400,200) *************** [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_69), Mul_70) (PointWiseV2) [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00767134 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00706264 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00681687 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00692158 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00674971 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00570637 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00676177 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00635448 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00664686 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00567191 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00761311 [02/13/2023-19:54:09] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.00567191 [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_69), Mul_70) (PointWise) [02/13/2023-19:54:09] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [02/13/2023-19:54:09] [V] [TRT] *************** Autotuning format combination: Float(28800,1:4,1600,50) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_69), Mul_70) (PointWiseV2) [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00595391 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00538192 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00572654 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00605352 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00582363 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00610933 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00692136 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00672935 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00659179 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00687456 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00687717 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00663148 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00582528 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00654338 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0061901 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00569565 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00681012 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00649475 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0063839 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00655605 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00786358 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00721897 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00700778 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00688936 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00595295 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00673226 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00770983 [02/13/2023-19:54:09] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.00538192 [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_69), Mul_70) (PointWise) [02/13/2023-19:54:09] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000001 [02/13/2023-19:54:09] [V] [TRT] *************** Autotuning format combination: Float(4032,576:32,32,1) -> Float(4032,576:32,32,1) *************** [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_69), Mul_70) (PointWiseV2) [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00712838 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0069403 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00693137 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00714583 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00707505 [02/13/2023-19:54:09] [V] [TRT] Fastest Tactic: 0x000000000000001a Time: 0.00693137 [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_69), Mul_70) (PointWise) [02/13/2023-19:54:09] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001a [02/13/2023-19:54:09] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_69), Mul_70) (PointWiseV2) [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.212658 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.282615 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.271863 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.394053 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.360951 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.260507 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.620786 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.462245 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.373403 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.358254 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000000a Time: 0.206222 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000000b Time: 0.257765 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000000c Time: 0.23701 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000000d Time: 0.333239 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000000e Time: 0.319913 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000000f Time: 0.234757 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.486327 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.414025 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.338629 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.284535 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.188549 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.247465 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.327109 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.484471 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0153966 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0175126 [02/13/2023-19:54:09] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0283215 [02/13/2023-19:54:09] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0153966 [02/13/2023-19:54:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:54:09] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:09] [V] [TRT] *************** Autotuning format combination: Float(115200,576,32,1) -> Float(115200,576,32,1) *************** [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: Conv_71 (CudaDepthwiseConvolution) [02/13/2023-19:54:09] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.012093 [02/13/2023-19:54:09] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.012093 [02/13/2023-19:54:09] [V] [TRT] --------------- Timing Runner: Conv_71 (CudnnConvolution) [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0271299 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0273912 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0273219 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000004 Time: 9.9198 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000005 Time: 10.9203 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.880014 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0271619 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.027251 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0273257 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x000000000000003c Time: 9.80044 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x000000000000003d Time: 10.9287 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x000000000000003e Time: 0.876169 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0276358 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.027504 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0273638 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000074 Time: 9.82362 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000075 Time: 10.934 [02/13/2023-19:54:10] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.880215 [02/13/2023-19:54:10] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0271299 [02/13/2023-19:54:10] [V] [TRT] --------------- Timing Runner: Conv_71 (CaskConvolution) [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 2.28987 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 2.47173 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 2.27295 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x4727434768e46395 Time: 1.50657 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 4.67273 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 2.6145 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 2.6243 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 2.31298 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 2.3231 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 1.83015 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:54:11] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 1.62733 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 2.20017 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 4.81856 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 1.79723 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:11] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 2.63344 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 2.32906 [02/13/2023-19:54:11] [V] [TRT] Fastest Tactic: 0x4727434768e46395 Time: 1.50657 [02/13/2023-19:54:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 0xffffffffffffffff [02/13/2023-19:54:11] [V] [TRT] *************** Autotuning format combination: Float(115200,1,6400,200) -> Float(115200,1,6400,200) *************** [02/13/2023-19:54:11] [V] [TRT] --------------- Timing Runner: Conv_71 (CaskConvolution) [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 2.22708 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 3.10174 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 5.57195 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf2 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x5030121339a48bf2 Time: 0.836091 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 2.21234 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 5.3572 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 2.16012 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d739 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0xca7eeb8d9143d739 Time: 0.853143 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:54:11] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 3.01062 [02/13/2023-19:54:11] [V] [TRT] Conv_71 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf50 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xd9031472c05adf50 Time: 0.844805 [02/13/2023-19:54:12] [V] [TRT] Conv_71 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 3.03882 [02/13/2023-19:54:12] [V] [TRT] Fastest Tactic: 0x5030121339a48bf2 Time: 0.836091 [02/13/2023-19:54:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5030121339a48bf2 [02/13/2023-19:54:12] [V] [TRT] *************** Autotuning format combination: Float(28800,1:4,1600,50) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_71 (CaskConvolution) [02/13/2023-19:54:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:12] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:12] [V] [TRT] *************** Autotuning format combination: Float(115200,576,32,1) -> Float(115200,576,32,1) *************** [02/13/2023-19:54:12] [V] [TRT] *************** Autotuning format combination: Float(115200,1,6400,200) -> Float(115200,1,6400,200) *************** [02/13/2023-19:54:12] [V] [TRT] *************** Autotuning format combination: Float(28800,1:4,1600,50) -> Float(28800,1:4,1600,50) *************** [02/13/2023-19:54:12] [V] [TRT] *************** Autotuning format combination: Float(4032,576:32,32,1) -> Float(4032,576:32,32,1) *************** [02/13/2023-19:54:12] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:12] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:12] [V] [TRT] *************** Autotuning format combination: Float(115200,576,32,1), Float(46080,576,32,1) -> Float(46080,576,32,1) *************** [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_74 + Add_75 (CudaDepthwiseConvolution) [02/13/2023-19:54:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_74 + Add_75 (FusedConvActConvolution) [02/13/2023-19:54:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_74 + Add_75 (CudnnConvolution) [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0372011 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.037176 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.104615 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.945467 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.146281 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0372171 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.037216 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000000003a Time: 0.104478 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000000003c Time: 0.935918 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000000003d Time: 0.141111 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0371017 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0372583 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.104485 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000074 Time: 0.937582 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.165376 [02/13/2023-19:54:12] [V] [TRT] Fastest Tactic: 0x0000000000000070 Time: 0.0371017 [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_74 + Add_75 (CublasConvolution) [02/13/2023-19:54:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_74 + Add_75 (CaskConvolution) [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0202069 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0209744 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0204408 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0227814 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0289317 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0432389 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0596465 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0224144 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0350619 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0307739 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.043128 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.049635 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0392663 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0308407 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0246027 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0285961 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0197989 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0253463 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0403989 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0368046 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0489798 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0294281 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0307456 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.039224 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0286656 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.0568457 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.035888 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.041304 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0435131 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0287799 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0338167 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0441291 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0309513 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0287141 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0436057 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.036952 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0893143 [02/13/2023-19:54:12] [V] [TRT] Fastest Tactic: 0x5f5015dbf902f0a3 Time: 0.0197989 [02/13/2023-19:54:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:12] [V] [TRT] *************** Autotuning format combination: Float(115200,1,6400,200), Float(46080,1,2560,80) -> Float(46080,1,2560,80) *************** [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_74 + Add_75 (CublasConvolution) [02/13/2023-19:54:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_74 + Add_75 (CaskConvolution) [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0265349 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0197166 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0413589 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0195891 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0286958 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0137509 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0266347 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0204813 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0205231 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0287269 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0178194 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0137795 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0190543 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0418263 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0179446 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.02512 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0252815 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.024451 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0135713 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0140571 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0411794 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0159802 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0263642 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0189326 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0180223 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0257478 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0265897 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0135057 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0178306 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0479604 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0260907 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0204167 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.026125 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0415177 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.041136 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0245615 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0159142 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0140148 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0396343 [02/13/2023-19:54:12] [V] [TRT] Fastest Tactic: 0xba269390692faead Time: 0.0135057 [02/13/2023-19:54:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xba269390692faead [02/13/2023-19:54:12] [V] [TRT] *************** Autotuning format combination: Float(28800,1:4,1600,50), Float(11520,1:4,640,20) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_74 + Add_75 (CublasConvolution) [02/13/2023-19:54:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_74 + Add_75 (CaskConvolution) [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0197851 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0197914 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0136582 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0176899 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0137866 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0186366 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0180297 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0252008 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.024525 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0134998 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0141793 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0157879 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.01898 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.018108 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0256411 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0135564 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.017876 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0244297 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0159168 [02/13/2023-19:54:12] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0140177 [02/13/2023-19:54:12] [V] [TRT] Fastest Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0134998 [02/13/2023-19:54:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:12] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:12] [V] [TRT] *************** Autotuning format combination: Float(46080,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_76 (CudaDepthwiseConvolution) [02/13/2023-19:54:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_76 (FusedConvActConvolution) [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.0506286 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.0390617 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.0432011 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.0383166 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000011ffff Time: 0.0373669 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.0376263 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.0371074 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.0394469 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000003cffff Time: 0.0388903 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.0390057 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000045ffff Time: 0.0354414 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000046ffff Time: 0.0358709 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000004affff Time: 0.0379726 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.0400446 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000004effff Time: 0.039224 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.0358571 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000051ffff Time: 0.0432846 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.0371657 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.0674194 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000059ffff Time: 0.037096 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000005effff Time: 0.037184 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000005fffff Time: 0.0372046 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.0386503 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.0350153 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.0520503 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.0350373 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000006fffff Time: 0.0390046 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.0490027 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.0388766 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.040648 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.0396149 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000091ffff Time: 0.0384571 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x00000000009dffff Time: 0.0389669 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.0373394 [02/13/2023-19:54:12] [V] [TRT] Fastest Tactic: 0x00000000006bffff Time: 0.0350153 [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_76 (CudnnConvolution) [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0308855 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0194109 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0613029 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.912827 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.111758 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0300581 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0192949 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0599451 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000000003c Time: 0.914569 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x000000000000003d Time: 0.0961897 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0305207 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0301861 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0610773 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000074 Time: 0.916654 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.0963497 [02/13/2023-19:54:12] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.0192949 [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_76 (CublasConvolution) [02/13/2023-19:54:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:12] [V] [TRT] --------------- Timing Runner: Conv_76 (CaskConvolution) [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.026611 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0245592 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0142882 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0283688 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0164658 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.026323 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0308507 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0160731 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0200731 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0244602 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0243299 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0308389 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0221838 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0223419 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0181257 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0201131 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0224901 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0181229 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0242918 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0186069 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0287534 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0171931 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.018076 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0223713 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.025744 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:12] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.0291419 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:12] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0181446 [02/13/2023-19:54:12] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.022353 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0238362 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0267078 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0199183 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0265783 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0183069 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0202954 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0244594 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0203714 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0433691 [02/13/2023-19:54:13] [V] [TRT] Fastest Tactic: 0x1016909b1fd6ff2f Time: 0.0142882 [02/13/2023-19:54:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:13] [V] [TRT] *************** Autotuning format combination: Float(46080,1,2560,80) -> Float(105984,1,5888,184) *************** [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: Conv_76 (CublasConvolution) [02/13/2023-19:54:13] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: Conv_76 (CaskConvolution) [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0237623 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0133839 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0225574 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0138144 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0159934 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.00983741 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0160843 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0201314 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0199137 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0159462 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0135011 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0113143 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0134292 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0225189 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0137829 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0159441 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0181034 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0167634 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0156649 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0116624 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.022289 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.018028 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0158075 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0125878 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0138822 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0182491 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0158898 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xba269390692faead Time: 0.014421 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0134425 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0264023 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.022511 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0188337 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0159873 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0224261 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0224627 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0177458 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0193137 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0108124 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0222824 [02/13/2023-19:54:13] [V] [TRT] Fastest Tactic: 0x2b4a5a2f546acbfd Time: 0.00983741 [02/13/2023-19:54:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:13] [V] [TRT] *************** Autotuning format combination: Float(11520,1:4,640,20) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: Conv_76 (CublasConvolution) [02/13/2023-19:54:13] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: Conv_76 (CaskConvolution) [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0132663 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0137251 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.00966735 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0134425 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0112862 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0133149 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0135185 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0181417 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0172424 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0157838 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0116962 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0180086 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0124606 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0137608 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0181909 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0145495 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0133989 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0178631 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.019364 [02/13/2023-19:54:13] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0105639 [02/13/2023-19:54:13] [V] [TRT] Fastest Tactic: 0x2b4a5a2f546acbfd Time: 0.00966735 [02/13/2023-19:54:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:13] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:13] [V] [TRT] *************** Autotuning format combination: Float(105984,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_77), Mul_78) (PointWiseV2) [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00718126 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00697165 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00641789 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00686716 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00592695 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00549732 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00655501 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00583369 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00563429 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00545134 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00718971 [02/13/2023-19:54:13] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.00545134 [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_77), Mul_78) (PointWise) [02/13/2023-19:54:13] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [02/13/2023-19:54:13] [V] [TRT] *************** Autotuning format combination: Float(105984,1,5888,184) -> Float(105984,1,5888,184) *************** [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_77), Mul_78) (PointWiseV2) [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00726651 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00702367 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00653486 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00689175 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0059019 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00556273 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00663335 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00589275 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00561917 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00550558 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00727977 [02/13/2023-19:54:13] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.00550558 [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_77), Mul_78) (PointWise) [02/13/2023-19:54:13] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [02/13/2023-19:54:13] [V] [TRT] *************** Autotuning format combination: Float(26496,1:4,1472,46) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_77), Mul_78) (PointWiseV2) [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00558347 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00538633 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00546218 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00548978 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00584174 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00595676 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00677818 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00661382 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00637376 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0066907 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00666639 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00597352 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00549521 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00590738 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00541917 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00542662 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00683385 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00579858 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0058187 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00591397 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00766653 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00714536 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00691918 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00663127 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0057069 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000001d Time: 0.006624 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00757005 [02/13/2023-19:54:13] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.00538633 [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_77), Mul_78) (PointWise) [02/13/2023-19:54:13] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000001 [02/13/2023-19:54:13] [V] [TRT] *************** Autotuning format combination: Float(3456,576:32,32,1) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_77), Mul_78) (PointWiseV2) [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00693007 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00669132 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00665184 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00703673 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00696337 [02/13/2023-19:54:13] [V] [TRT] Fastest Tactic: 0x000000000000001a Time: 0.00665184 [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_77), Mul_78) (PointWise) [02/13/2023-19:54:13] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001a [02/13/2023-19:54:13] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_77), Mul_78) (PointWiseV2) [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.19189 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.260713 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.250185 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.363419 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.334377 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.23808 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.574181 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.424677 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.339598 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.327438 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000000a Time: 0.185888 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000000b Time: 0.236119 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000000c Time: 0.2144 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000000d Time: 0.307666 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000000e Time: 0.293431 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000000f Time: 0.212393 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.447337 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.38256 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.311273 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.256389 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.168777 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.228 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.300119 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.445961 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0119874 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0159269 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0240244 [02/13/2023-19:54:13] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0119874 [02/13/2023-19:54:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:54:13] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:13] [V] [TRT] *************** Autotuning format combination: Float(105984,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: Conv_79 (CudaDepthwiseConvolution) [02/13/2023-19:54:13] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.0113966 [02/13/2023-19:54:13] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.0113966 [02/13/2023-19:54:13] [V] [TRT] --------------- Timing Runner: Conv_79 (CudnnConvolution) [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0254545 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0254453 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0254232 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000004 Time: 8.98489 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000005 Time: 10.0617 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.808864 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0254491 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0254613 [02/13/2023-19:54:13] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0254872 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x000000000000003c Time: 8.70208 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x000000000000003d Time: 10.0578 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x000000000000003e Time: 0.809888 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0258339 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0255642 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0258575 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x0000000000000074 Time: 8.6904 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x0000000000000075 Time: 10.0563 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.809417 [02/13/2023-19:54:14] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.0254232 [02/13/2023-19:54:14] [V] [TRT] --------------- Timing Runner: Conv_79 (CaskConvolution) [02/13/2023-19:54:14] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 2.109 [02/13/2023-19:54:14] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 2.28809 [02/13/2023-19:54:14] [V] [TRT] Conv_79 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 2.08836 [02/13/2023-19:54:14] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x4727434768e46395 Time: 1.39086 [02/13/2023-19:54:14] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 4.30746 [02/13/2023-19:54:14] [V] [TRT] Conv_79 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 2.40859 [02/13/2023-19:54:14] [V] [TRT] Conv_79 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 2.41866 [02/13/2023-19:54:14] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 2.12747 [02/13/2023-19:54:14] [V] [TRT] Conv_79 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 2.13829 [02/13/2023-19:54:14] [V] [TRT] Conv_79 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:54:14] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 1.69301 [02/13/2023-19:54:14] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:54:14] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 1.50916 [02/13/2023-19:54:14] [V] [TRT] Conv_79 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 2.02405 [02/13/2023-19:54:14] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:54:14] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 4.45953 [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 1.65645 [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 2.42929 [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 2.13468 [02/13/2023-19:54:15] [V] [TRT] Fastest Tactic: 0x4727434768e46395 Time: 1.39086 [02/13/2023-19:54:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 0xffffffffffffffff [02/13/2023-19:54:15] [V] [TRT] *************** Autotuning format combination: Float(105984,1,5888,184) -> Float(105984,1,5888,184) *************** [02/13/2023-19:54:15] [V] [TRT] --------------- Timing Runner: Conv_79 (CaskConvolution) [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 2.05861 [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 2.84582 [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 5.12926 [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf2 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x5030121339a48bf2 Time: 0.771013 [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 2.04328 [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 4.95859 [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 1.9968 [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d739 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xca7eeb8d9143d739 Time: 0.785751 [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 2.77649 [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf50 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xd9031472c05adf50 Time: 0.778263 [02/13/2023-19:54:15] [V] [TRT] Conv_79 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 2.79003 [02/13/2023-19:54:15] [V] [TRT] Fastest Tactic: 0x5030121339a48bf2 Time: 0.771013 [02/13/2023-19:54:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5030121339a48bf2 [02/13/2023-19:54:15] [V] [TRT] *************** Autotuning format combination: Float(26496,1:4,1472,46) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:54:15] [V] [TRT] --------------- Timing Runner: Conv_79 (CaskConvolution) [02/13/2023-19:54:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:15] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:15] [V] [TRT] *************** Autotuning format combination: Float(105984,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:54:15] [V] [TRT] *************** Autotuning format combination: Float(105984,1,5888,184) -> Float(105984,1,5888,184) *************** [02/13/2023-19:54:15] [V] [TRT] *************** Autotuning format combination: Float(26496,1:4,1472,46) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:54:15] [V] [TRT] *************** Autotuning format combination: Float(3456,576:32,32,1) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:54:15] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:15] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:15] [V] [TRT] *************** Autotuning format combination: Float(105984,576,32,1), Float(46080,576,32,1) -> Float(46080,576,32,1) *************** [02/13/2023-19:54:15] [V] [TRT] --------------- Timing Runner: Conv_82 + Add_83 (CudaDepthwiseConvolution) [02/13/2023-19:54:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:15] [V] [TRT] --------------- Timing Runner: Conv_82 + Add_83 (FusedConvActConvolution) [02/13/2023-19:54:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:15] [V] [TRT] --------------- Timing Runner: Conv_82 + Add_83 (CudnnConvolution) [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0364263 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0357257 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0969623 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.883854 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.133486 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0361977 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0361029 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0975269 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x000000000000003c Time: 0.883675 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x000000000000003d Time: 0.130021 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0367211 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0360743 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0974606 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x0000000000000074 Time: 0.885033 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.129911 [02/13/2023-19:54:15] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0357257 [02/13/2023-19:54:15] [V] [TRT] --------------- Timing Runner: Conv_82 + Add_83 (CublasConvolution) [02/13/2023-19:54:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:15] [V] [TRT] --------------- Timing Runner: Conv_82 + Add_83 (CaskConvolution) [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0202394 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0181354 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.02036 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0202503 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0284236 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0413291 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0560899 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0224033 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0328558 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0283497 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0411314 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.04756 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0376606 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0289902 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.022622 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0277432 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0182189 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0229688 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0390469 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0351031 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0457063 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0286144 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0287433 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0370057 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0273173 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.053923 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0350528 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0391474 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0405783 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0286354 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0326235 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0413257 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0288183 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0264084 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0411874 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0347383 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0832526 [02/13/2023-19:54:15] [V] [TRT] Fastest Tactic: 0x09aeee2f1beac383 Time: 0.0181354 [02/13/2023-19:54:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:15] [V] [TRT] *************** Autotuning format combination: Float(105984,1,5888,184), Float(46080,1,2560,80) -> Float(46080,1,2560,80) *************** [02/13/2023-19:54:15] [V] [TRT] --------------- Timing Runner: Conv_82 + Add_83 (CublasConvolution) [02/13/2023-19:54:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:15] [V] [TRT] --------------- Timing Runner: Conv_82 + Add_83 (CaskConvolution) [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0245455 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0182097 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0393166 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0181309 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0270339 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0133257 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0246758 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0199097 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0200914 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0278309 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.015824 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0127109 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0179851 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.039272 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0168046 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0244975 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0243779 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0224444 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0124095 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0135705 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0383326 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0137151 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0244937 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0184314 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0160132 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0242926 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0246918 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0119033 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.016159 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0461143 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.024464 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0184771 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.024499 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0391783 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0381703 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.02243 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0139873 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0138855 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.037184 [02/13/2023-19:54:15] [V] [TRT] Fastest Tactic: 0xba269390692faead Time: 0.0119033 [02/13/2023-19:54:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xba269390692faead [02/13/2023-19:54:15] [V] [TRT] *************** Autotuning format combination: Float(26496,1:4,1472,46), Float(11520,1:4,640,20) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:54:15] [V] [TRT] --------------- Timing Runner: Conv_82 + Add_83 (CublasConvolution) [02/13/2023-19:54:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:15] [V] [TRT] --------------- Timing Runner: Conv_82 + Add_83 (CaskConvolution) [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0183914 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0180937 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0132692 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0158738 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0123638 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0180309 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0167487 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0244023 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.022481 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0125874 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0134487 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0136657 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0181549 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0160452 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0244251 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0118003 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:15] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0163413 [02/13/2023-19:54:15] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0224091 [02/13/2023-19:54:16] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0140596 [02/13/2023-19:54:16] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0138024 [02/13/2023-19:54:16] [V] [TRT] Fastest Tactic: 0xba269390692faead Time: 0.0118003 [02/13/2023-19:54:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xba269390692faead [02/13/2023-19:54:16] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(46080,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(46080,1,2560,80) -> Float(105984,1,5888,184) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(11520,1:4,640,20) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:54:16] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(105984,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(105984,1,5888,184) -> Float(105984,1,5888,184) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(26496,1:4,1472,46) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(3456,576:32,32,1) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:16] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(105984,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(105984,1,5888,184) -> Float(105984,1,5888,184) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(26496,1:4,1472,46) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: Conv_87 (CaskConvolution) [02/13/2023-19:54:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:16] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(105984,576,32,1) -> Float(105984,576,32,1) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(105984,1,5888,184) -> Float(105984,1,5888,184) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(26496,1:4,1472,46) -> Float(26496,1:4,1472,46) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(3456,576:32,32,1) -> Float(3456,576:32,32,1) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:16] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(105984,576,32,1), Float(46080,576,32,1) -> Float(46080,576,32,1) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(105984,1,5888,184), Float(46080,1,2560,80) -> Float(46080,1,2560,80) *************** [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(26496,1:4,1472,46), Float(11520,1:4,640,20) -> Float(11520,1:4,640,20) *************** [02/13/2023-19:54:16] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(46080,576,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: Conv_92 (CudaDepthwiseConvolution) [02/13/2023-19:54:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: Conv_92 (FusedConvActConvolution) [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.11496 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.0809783 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.0816069 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.0766149 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000011ffff Time: 0.0747109 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.0804549 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.0746789 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.0857006 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000003cffff Time: 0.0777371 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.0807543 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000045ffff Time: 0.0750331 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000046ffff Time: 0.0739451 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000004affff Time: 0.0771886 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.0801806 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000004effff Time: 0.0795269 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.0781257 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000051ffff Time: 0.0903223 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.0782446 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.145518 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000059ffff Time: 0.077392 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000005effff Time: 0.0768914 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000005fffff Time: 0.0752297 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.0861006 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.0758514 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.114485 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.0814926 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000006fffff Time: 0.0774034 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.0926537 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.0773737 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.080752 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.08264 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000091ffff Time: 0.0774149 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x00000000009dffff Time: 0.0810011 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.0754834 [02/13/2023-19:54:16] [V] [TRT] Fastest Tactic: 0x000000000046ffff Time: 0.0739451 [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: Conv_92 (CudnnConvolution) [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0515429 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0285925 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0804137 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000004 Time: 2.31072 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.257467 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0517562 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.028736 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0806423 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000000003c Time: 2.32995 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000000003d Time: 0.258638 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0513387 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0514849 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0804503 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000074 Time: 2.31907 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.258432 [02/13/2023-19:54:16] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0285925 [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: Conv_92 (CublasConvolution) [02/13/2023-19:54:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: Conv_92 (CaskConvolution) [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.03764 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0489036 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0349623 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0565851 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0332855 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.026589 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.045832 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0397577 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0354853 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0621181 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.038576 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0309065 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0397143 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.039416 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0458251 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.035339 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0314149 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0393977 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.044864 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0249333 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0293339 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0332489 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0409943 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0335003 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0454274 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.043712 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0248983 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0373429 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.03836 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0394697 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0318839 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0268701 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0496747 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.04572 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.039632 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0357657 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0434857 [02/13/2023-19:54:16] [V] [TRT] Fastest Tactic: 0xa419b3b68f2da07b Time: 0.0248983 [02/13/2023-19:54:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(46080,1,2560,80) -> Float(276480,1,15360,480) *************** [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: Conv_92 (CublasConvolution) [02/13/2023-19:54:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: Conv_92 (CaskConvolution) [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0311726 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0164714 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0360206 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0227024 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0336375 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.020244 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0310638 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.039288 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0390263 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0336722 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0252518 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.023023 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0209502 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.036128 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0208333 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.028715 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0183857 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0183566 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0211507 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0251421 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0360023 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0338953 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0276571 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0164978 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0274469 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0185903 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0319131 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0206446 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0206609 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0392834 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0308809 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0383257 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0306853 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0371554 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0360046 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0184091 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0366023 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.022193 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0361463 [02/13/2023-19:54:16] [V] [TRT] Fastest Tactic: 0x130df49cb195156b Time: 0.0164714 [02/13/2023-19:54:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x130df49cb195156b [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(11520,1:4,640,20) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: Conv_92 (CublasConvolution) [02/13/2023-19:54:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: Conv_92 (CaskConvolution) [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0164744 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0224725 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0204506 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0249973 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0231491 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0207223 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0207053 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.01844 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0184149 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0211285 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0251291 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0337856 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0165435 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0274621 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0185486 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0206217 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0206348 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0183594 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0369154 [02/13/2023-19:54:16] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0223007 [02/13/2023-19:54:16] [V] [TRT] Fastest Tactic: 0x130df49cb195156b Time: 0.0164744 [02/13/2023-19:54:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x130df49cb195156b [02/13/2023-19:54:16] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(276480,576,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_93), Mul_94) (PointWiseV2) [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0128038 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0103984 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00970667 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.009376 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00922914 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00904743 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00945343 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00871718 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00874783 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00890192 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0123642 [02/13/2023-19:54:16] [V] [TRT] Fastest Tactic: 0x0000000000000007 Time: 0.00871718 [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_93), Mul_94) (PointWise) [02/13/2023-19:54:16] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000007 [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(276480,1,15360,480) -> Float(276480,1,15360,480) *************** [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_93), Mul_94) (PointWiseV2) [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.01276 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.010738 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00952564 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00933829 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00901114 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00898943 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00943371 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00905143 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00897171 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00909657 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0120366 [02/13/2023-19:54:16] [V] [TRT] Fastest Tactic: 0x0000000000000008 Time: 0.00897171 [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_93), Mul_94) (PointWise) [02/13/2023-19:54:16] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000008 [02/13/2023-19:54:16] [V] [TRT] *************** Autotuning format combination: Float(69120,1:4,3840,120) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:54:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_93), Mul_94) (PointWiseV2) [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00831975 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00883281 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00915571 [02/13/2023-19:54:16] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00882582 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00962194 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00898086 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00926857 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00918143 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00930371 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00946886 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00964846 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00954697 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00896571 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00925543 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00884598 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x000000000000000f Time: 0.009338 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.009474 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00917371 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00929857 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00910714 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0141856 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0117978 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00979749 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00931886 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00878682 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00972282 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0135173 [02/13/2023-19:54:17] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00831975 [02/13/2023-19:54:17] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_93), Mul_94) (PointWise) [02/13/2023-19:54:17] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [02/13/2023-19:54:17] [V] [TRT] *************** Autotuning format combination: Float(8640,576:32,32,1) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:54:17] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_93), Mul_94) (PointWiseV2) [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00854669 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00895457 [02/13/2023-19:54:17] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00930229 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00922114 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00835835 [02/13/2023-19:54:18] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00835835 [02/13/2023-19:54:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_93), Mul_94) (PointWise) [02/13/2023-19:54:18] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [02/13/2023-19:54:18] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_93), Mul_94) (PointWiseV2) [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.53093 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.673815 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.657568 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.941207 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.863867 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.628055 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000006 Time: 1.48536 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000007 Time: 1.10391 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.924439 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.977042 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x000000000000000a Time: 0.512087 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x000000000000000b Time: 0.618281 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x000000000000000c Time: 0.578711 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x000000000000000d Time: 0.796896 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x000000000000000e Time: 0.766912 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x000000000000000f Time: 0.571429 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000010 Time: 1.1609 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.992763 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.817179 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.708032 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.472411 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.603854 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.784375 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000017 Time: 1.15795 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0530362 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0535238 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0704305 [02/13/2023-19:54:18] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0530362 [02/13/2023-19:54:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:54:18] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:18] [V] [TRT] *************** Autotuning format combination: Float(276480,576,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:54:18] [V] [TRT] --------------- Timing Runner: Conv_95 (CudaDepthwiseConvolution) [02/13/2023-19:54:18] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.0208692 [02/13/2023-19:54:18] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.0208692 [02/13/2023-19:54:18] [V] [TRT] --------------- Timing Runner: Conv_95 (CudnnConvolution) [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0468457 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.047584 [02/13/2023-19:54:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0470537 [02/13/2023-19:54:19] [V] [TRT] Tactic: 0x0000000000000004 Time: 22.3446 [02/13/2023-19:54:19] [V] [TRT] Tactic: 0x0000000000000005 Time: 26.1898 [02/13/2023-19:54:19] [V] [TRT] Tactic: 0x0000000000000006 Time: 2.09232 [02/13/2023-19:54:19] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0465726 [02/13/2023-19:54:19] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0468034 [02/13/2023-19:54:19] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0465886 [02/13/2023-19:54:19] [V] [TRT] Tactic: 0x000000000000003c Time: 22.4297 [02/13/2023-19:54:19] [V] [TRT] Tactic: 0x000000000000003d Time: 26.6972 [02/13/2023-19:54:19] [V] [TRT] Tactic: 0x000000000000003e Time: 2.0861 [02/13/2023-19:54:19] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0466971 [02/13/2023-19:54:19] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0478598 [02/13/2023-19:54:19] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.047456 [02/13/2023-19:54:20] [V] [TRT] Tactic: 0x0000000000000074 Time: 22.5195 [02/13/2023-19:54:20] [V] [TRT] Tactic: 0x0000000000000075 Time: 26.1733 [02/13/2023-19:54:20] [V] [TRT] Tactic: 0x0000000000000076 Time: 2.09099 [02/13/2023-19:54:20] [V] [TRT] Fastest Tactic: 0x0000000000000038 Time: 0.0465726 [02/13/2023-19:54:20] [V] [TRT] --------------- Timing Runner: Conv_95 (CaskConvolution) [02/13/2023-19:54:20] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:54:20] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 5.49538 [02/13/2023-19:54:20] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:54:20] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 5.77607 [02/13/2023-19:54:20] [V] [TRT] Conv_95 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:20] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 5.40469 [02/13/2023-19:54:20] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:54:20] [V] [TRT] Tactic: 0x4727434768e46395 Time: 3.61806 [02/13/2023-19:54:20] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:54:20] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 11.1323 [02/13/2023-19:54:20] [V] [TRT] Conv_95 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:21] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 6.15288 [02/13/2023-19:54:21] [V] [TRT] Conv_95 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:54:21] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 6.27129 [02/13/2023-19:54:21] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:54:21] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 5.53862 [02/13/2023-19:54:21] [V] [TRT] Conv_95 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:54:21] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 5.57073 [02/13/2023-19:54:21] [V] [TRT] Conv_95 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:54:21] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 4.35707 [02/13/2023-19:54:21] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:54:21] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 3.74943 [02/13/2023-19:54:21] [V] [TRT] Conv_95 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:21] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 5.15424 [02/13/2023-19:54:21] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:54:21] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 11.5482 [02/13/2023-19:54:21] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:54:21] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 4.19611 [02/13/2023-19:54:21] [V] [TRT] Conv_95 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:21] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 6.26138 [02/13/2023-19:54:21] [V] [TRT] Conv_95 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:21] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 5.5638 [02/13/2023-19:54:21] [V] [TRT] Fastest Tactic: 0x4727434768e46395 Time: 3.61806 [02/13/2023-19:54:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 0xffffffffffffffff [02/13/2023-19:54:21] [V] [TRT] *************** Autotuning format combination: Float(276480,1,15360,480) -> Float(276480,1,15360,480) *************** [02/13/2023-19:54:21] [V] [TRT] --------------- Timing Runner: Conv_95 (CaskConvolution) [02/13/2023-19:54:22] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 5.2864 [02/13/2023-19:54:22] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 7.40267 [02/13/2023-19:54:22] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 13.2783 [02/13/2023-19:54:22] [V] [TRT] Conv_95 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf2 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x5030121339a48bf2 Time: 1.99807 [02/13/2023-19:54:22] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 5.28381 [02/13/2023-19:54:22] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 13.6489 [02/13/2023-19:54:22] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 5.12616 [02/13/2023-19:54:22] [V] [TRT] Conv_95 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d739 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0xca7eeb8d9143d739 Time: 2.03805 [02/13/2023-19:54:22] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 7.15583 [02/13/2023-19:54:22] [V] [TRT] Conv_95 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf50 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0xd9031472c05adf50 Time: 2.01188 [02/13/2023-19:54:22] [V] [TRT] Conv_95 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:54:22] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 7.2407 [02/13/2023-19:54:22] [V] [TRT] Fastest Tactic: 0x5030121339a48bf2 Time: 1.99807 [02/13/2023-19:54:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5030121339a48bf2 [02/13/2023-19:54:22] [V] [TRT] *************** Autotuning format combination: Float(69120,1:4,3840,120) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:54:22] [V] [TRT] --------------- Timing Runner: Conv_95 (CaskConvolution) [02/13/2023-19:54:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:22] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:22] [V] [TRT] *************** Autotuning format combination: Float(276480,576,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:54:22] [V] [TRT] *************** Autotuning format combination: Float(276480,1,15360,480) -> Float(276480,1,15360,480) *************** [02/13/2023-19:54:22] [V] [TRT] *************** Autotuning format combination: Float(69120,1:4,3840,120) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:54:22] [V] [TRT] *************** Autotuning format combination: Float(8640,576:32,32,1) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:54:22] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:22] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:22] [V] [TRT] *************** Autotuning format combination: Float(276480,576,32,1) -> Float(480,1,1,1) *************** [02/13/2023-19:54:22] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_98 (TiledPooling) [02/13/2023-19:54:22] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [02/13/2023-19:54:22] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_98 (CudnnPooling) [02/13/2023-19:54:22] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00926657 [02/13/2023-19:54:22] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00926657 [02/13/2023-19:54:22] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_98 (CaskPooling) [02/13/2023-19:54:22] [V] [TRT] GlobalAveragePool_98 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Average_FastDiv Tactic: 0x933eceba7b866d59 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x933eceba7b866d59 Time: 0.00943086 [02/13/2023-19:54:22] [V] [TRT] Fastest Tactic: 0x933eceba7b866d59 Time: 0.00943086 [02/13/2023-19:54:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: 0xffffffffffffffff [02/13/2023-19:54:22] [V] [TRT] *************** Autotuning format combination: Float(69120,1:4,3840,120) -> Float(120,1:4,120,120) *************** [02/13/2023-19:54:22] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_98 (CaskPooling) [02/13/2023-19:54:22] [V] [TRT] GlobalAveragePool_98 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Average_FastDiv_CAlign4 Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:54:22] [V] [TRT] Tactic: 0xfab3e2ee1c085a9a Time: 0.00960671 [02/13/2023-19:54:22] [V] [TRT] Fastest Tactic: 0xfab3e2ee1c085a9a Time: 0.00960671 [02/13/2023-19:54:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:54:22] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:22] [V] [TRT] *************** Autotuning format combination: Float(480,1,1,1) -> Float(120,1,1,1) *************** [02/13/2023-19:54:22] [V] [TRT] --------------- Timing Runner: Conv_99 + Relu_100 (CudaDepthwiseConvolution) [02/13/2023-19:54:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:22] [V] [TRT] --------------- Timing Runner: Conv_99 + Relu_100 (FusedConvActConvolution) [02/13/2023-19:54:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:22] [V] [TRT] --------------- Timing Runner: Conv_99 + Relu_100 (CudnnConvolution) [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0397166 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0540846 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0864183 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.03877 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.168393 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0402137 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0546865 [02/13/2023-19:54:22] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0868754 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x000000000000003c Time: 1.04525 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x000000000000003d Time: 0.170661 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.040552 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0421131 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0867954 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000074 Time: 1.05191 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.169838 [02/13/2023-19:54:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0397166 [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_99 + Relu_100 (CublasConvolution) [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0115035 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.011469 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.011597 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0114701 [02/13/2023-19:54:23] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.011469 [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_99 + Relu_100 (CaskConvolution) [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0244328 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0160051 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0248503 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0159848 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0349934 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0499429 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0985074 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0267307 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0660023 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.037352 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0838446 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0597242 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.041504 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0412503 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0329307 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0393349 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0223079 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0181274 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.043472 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0351753 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0577463 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0330231 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0537752 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0734697 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0500724 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.0965029 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0330871 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0754697 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0815109 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xaa0953b1a73b0b9b Time: 0.00722469 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0518781 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0627093 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0503893 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0542034 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0186371 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0853371 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0688564 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.16635 [02/13/2023-19:54:23] [V] [TRT] Fastest Tactic: 0xaa0953b1a73b0b9b Time: 0.00722469 [02/13/2023-19:54:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:23] [V] [TRT] *************** Autotuning format combination: Float(480,1,480,480) -> Float(120,1,120,120) *************** [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_99 + Relu_100 (CublasConvolution) [02/13/2023-19:54:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_99 + Relu_100 (CaskConvolution) [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0442549 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0245166 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0810811 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.024736 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.051901 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0160889 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0439166 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0308608 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0316462 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0520457 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0133984 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0161661 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0242705 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0816297 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0223445 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0288613 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0352091 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0348672 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0160376 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0178743 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0805257 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0116329 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.028672 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0246392 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0139021 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0351122 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0459371 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0158149 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0218155 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.075328 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0435554 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0304658 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.043336 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0831566 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0808137 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0350345 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0117064 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.016669 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0791017 [02/13/2023-19:54:23] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.0116329 [02/13/2023-19:54:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:54:23] [V] [TRT] *************** Autotuning format combination: Float(120,1:4,120,120) -> Float(30,1:4,30,30) *************** [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_99 + Relu_100 (CublasConvolution) [02/13/2023-19:54:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_99 + Relu_100 (CaskConvolution) [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0244389 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0245021 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0161956 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0134462 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0160914 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0243627 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0222589 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0348626 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0345737 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0161295 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0178311 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0115306 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0245509 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.01375 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0351113 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0159416 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0215726 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0350373 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0116346 [02/13/2023-19:54:23] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0164221 [02/13/2023-19:54:23] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.0115306 [02/13/2023-19:54:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:54:23] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:23] [V] [TRT] *************** Autotuning format combination: Float(120,1,1,1) -> Float(480,1,1,1) *************** [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_101 (CudaDepthwiseConvolution) [02/13/2023-19:54:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_101 (FusedConvActConvolution) [02/13/2023-19:54:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_101 (CudnnConvolution) [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0170093 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0170677 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0414686 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.05773 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.216645 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0169961 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.017151 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0415314 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x000000000000003c Time: 1.05364 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x000000000000003d Time: 0.214528 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0171124 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0171581 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0412491 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000074 Time: 1.05607 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.217486 [02/13/2023-19:54:23] [V] [TRT] Fastest Tactic: 0x0000000000000038 Time: 0.0169961 [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_101 (CublasConvolution) [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116895 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.011571 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0117074 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0119413 [02/13/2023-19:54:23] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.011571 [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_101 (CaskConvolution) [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.016191 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.00940771 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0159868 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.00966248 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0139321 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0267131 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0371417 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.017858 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.024403 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.022528 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0292544 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0309522 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0224784 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0222896 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0181131 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0203177 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0139931 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0114813 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0247581 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0203926 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.028811 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0138676 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0204565 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.025469 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0203109 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.0352174 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0201166 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0266225 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0289801 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xaa0953b1a73b0b9b Time: 0.00602305 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0204846 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0237525 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.026931 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.02237 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0118544 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0308242 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0246034 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0537691 [02/13/2023-19:54:23] [V] [TRT] Fastest Tactic: 0xaa0953b1a73b0b9b Time: 0.00602305 [02/13/2023-19:54:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:23] [V] [TRT] *************** Autotuning format combination: Float(120,1,120,120) -> Float(480,1,480,480) *************** [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_101 (CublasConvolution) [02/13/2023-19:54:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_101 (CaskConvolution) [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0181657 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0134412 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0270392 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0135493 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0204121 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.00957044 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0181057 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0157147 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0157019 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0204108 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00790785 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.00948371 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0118984 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0278636 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0133066 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0133444 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0169402 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0173476 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.00992335 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0106384 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0270697 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.00760181 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0121387 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0133199 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.00887341 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0178703 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0186406 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xba269390692faead Time: 0.00977036 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.01216 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0305755 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0179583 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0143534 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0179589 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0286016 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0270301 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0178634 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.00762105 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0105358 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0266316 [02/13/2023-19:54:23] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.00760181 [02/13/2023-19:54:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:54:23] [V] [TRT] *************** Autotuning format combination: Float(30,1:4,30,30) -> Float(120,1:4,120,120) *************** [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_101 (CublasConvolution) [02/13/2023-19:54:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:23] [V] [TRT] --------------- Timing Runner: Conv_101 (CaskConvolution) [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0133718 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:23] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0133881 [02/13/2023-19:54:23] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.00950686 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00785299 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.00964571 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0119015 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0130377 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0170992 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0173547 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.00987672 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0109195 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.00778707 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.013327 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:24] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.009146 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:24] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0176777 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:24] [V] [TRT] Tactic: 0xba269390692faead Time: 0.00973714 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.012419 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:24] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0178499 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:24] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.00777215 [02/13/2023-19:54:24] [V] [TRT] Conv_101 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0106958 [02/13/2023-19:54:24] [V] [TRT] Fastest Tactic: 0xed09dcddfcf4bffb Time: 0.00777215 [02/13/2023-19:54:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:24] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:24] [V] [TRT] *************** Autotuning format combination: Float(480,1,1,1), Float(276480,576,32,1) -> Float(276480,576,32,1) *************** [02/13/2023-19:54:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_102), Mul_103) (PointWiseV2) [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0210371 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0250377 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0234932 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0292663 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0305243 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.02704 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0378011 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0371531 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0373406 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0366869 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0208287 [02/13/2023-19:54:24] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0208287 [02/13/2023-19:54:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_102), Mul_103) (PointWise) [02/13/2023-19:54:24] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:54:24] [V] [TRT] *************** Autotuning format combination: Float(480,1,480,480), Float(276480,1,15360,480) -> Float(276480,1,15360,480) *************** [02/13/2023-19:54:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_102), Mul_103) (PointWiseV2) [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0248038 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0186286 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0168462 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0124274 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0137463 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0126069 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0109176 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0106054 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0102704 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0105731 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0236291 [02/13/2023-19:54:24] [V] [TRT] Fastest Tactic: 0x0000000000000008 Time: 0.0102704 [02/13/2023-19:54:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_102), Mul_103) (PointWise) [02/13/2023-19:54:24] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000008 [02/13/2023-19:54:24] [V] [TRT] *************** Autotuning format combination: Float(120,1:4,120,120), Float(69120,1:4,3840,120) -> Float(69120,1:4,3840,120) *************** [02/13/2023-19:54:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_102), Mul_103) (PointWiseV2) [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0175086 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0175319 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0218808 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0173603 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0209691 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.031552 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.018984 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0209123 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0246598 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0260678 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x000000000000000a Time: 0.017928 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0172241 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0177326 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0169204 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0178989 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0228911 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0172592 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0191029 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0216046 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0315538 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0262537 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0193846 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0140999 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0117278 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0177077 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0172013 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0254674 [02/13/2023-19:54:24] [V] [TRT] Fastest Tactic: 0x0000000000000017 Time: 0.0117278 [02/13/2023-19:54:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_102), Mul_103) (PointWise) [02/13/2023-19:54:24] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000017 [02/13/2023-19:54:24] [V] [TRT] *************** Autotuning format combination: Float(15,1:32,1,1), Float(8640,576:32,32,1) -> Float(8640,576:32,32,1) *************** [02/13/2023-19:54:24] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_102), Mul_103) (PointWiseV2) [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0173338 [02/13/2023-19:54:24] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0180149 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0180846 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0171225 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0174908 [02/13/2023-19:54:25] [V] [TRT] Fastest Tactic: 0x000000000000001b Time: 0.0171225 [02/13/2023-19:54:25] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_102), Mul_103) (PointWise) [02/13/2023-19:54:25] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001b [02/13/2023-19:54:25] [V] [TRT] *************** Autotuning format combination: Float(1:4,1,1,1), Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:25] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_102), Mul_103) (PointWiseV2) [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.882414 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x0000000000000001 Time: 1.08643 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x0000000000000002 Time: 1.05889 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x0000000000000003 Time: 1.42541 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.41641 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.04859 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x0000000000000006 Time: 2.1018 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x0000000000000007 Time: 1.77977 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x0000000000000008 Time: 1.90412 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.46942 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x000000000000000a Time: 0.806363 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x000000000000000b Time: 1.0184 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x000000000000000c Time: 0.875977 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x000000000000000d Time: 1.27217 [02/13/2023-19:54:25] [V] [TRT] Tactic: 0x000000000000000e Time: 1.20928 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000000000f Time: 0.890286 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000010 Time: 1.78744 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000011 Time: 1.62928 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000012 Time: 1.87772 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000013 Time: 1.24721 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.709934 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.91141 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000016 Time: 1.11121 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000017 Time: 1.51833 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000000001c Time: 0.071552 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0676632 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000000001e Time: 0.097248 [02/13/2023-19:54:26] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.0676632 [02/13/2023-19:54:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [02/13/2023-19:54:26] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:26] [V] [TRT] *************** Autotuning format combination: Float(276480,576,32,1) -> Float(64512,576,32,1) *************** [02/13/2023-19:54:26] [V] [TRT] --------------- Timing Runner: Conv_104 (CudaDepthwiseConvolution) [02/13/2023-19:54:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:26] [V] [TRT] --------------- Timing Runner: Conv_104 (FusedConvActConvolution) [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.148695 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.0948686 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.0760114 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.0661531 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000011ffff Time: 0.0539931 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.0670629 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000001fffff Time: 0.0709288 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.0514591 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.0901234 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000003cffff Time: 0.0695589 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.0760046 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000040ffff Time: 0.0603398 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000045ffff Time: 0.0606918 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000046ffff Time: 0.0554042 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000004affff Time: 0.0709791 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.0700861 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000004effff Time: 0.0599771 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.0576914 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000051ffff Time: 0.0726651 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.0679147 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.178921 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000059ffff Time: 0.0567604 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000005effff Time: 0.0534827 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000005fffff Time: 0.0539947 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.0683764 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000006affff Time: 0.0714697 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.0512427 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.120821 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.0644587 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000006fffff Time: 0.0578728 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.0855931 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.0555078 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.0842217 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.0637303 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000008affff Time: 0.0691185 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000091ffff Time: 0.0708648 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x00000000009dffff Time: 0.0679817 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.0548251 [02/13/2023-19:54:26] [V] [TRT] Fastest Tactic: 0x00000000006bffff Time: 0.0512427 [02/13/2023-19:54:26] [V] [TRT] --------------- Timing Runner: Conv_104 (CudnnConvolution) [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0637516 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.062653 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.223026 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000004 Time: 2.99856 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.364864 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0636709 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0619185 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000000003a Time: 0.143529 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000000003c Time: 2.96231 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x000000000000003d Time: 0.365385 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0638522 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0623314 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.146926 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000074 Time: 3.00165 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.368462 [02/13/2023-19:54:26] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.0619185 [02/13/2023-19:54:26] [V] [TRT] --------------- Timing Runner: Conv_104 (CublasConvolution) [02/13/2023-19:54:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:26] [V] [TRT] --------------- Timing Runner: Conv_104 (CaskConvolution) [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0248366 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0394011 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0268076 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0422766 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0562453 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0542598 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0991063 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0288073 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0666484 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0395063 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0844663 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0625615 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.043288 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0437314 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0333504 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0414366 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0227331 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0330158 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0456354 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0376389 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0606796 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0561295 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.05424 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0785669 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0511512 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.0975726 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:26] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0372309 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0816891 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0837189 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:26] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0520274 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0632259 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0546484 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0542842 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0352741 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:26] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0853257 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0689981 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.16971 [02/13/2023-19:54:26] [V] [TRT] Fastest Tactic: 0x5f5015dbf902f0a3 Time: 0.0227331 [02/13/2023-19:54:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:26] [V] [TRT] *************** Autotuning format combination: Float(276480,1,15360,480) -> Float(64512,1,3584,112) *************** [02/13/2023-19:54:26] [V] [TRT] --------------- Timing Runner: Conv_104 (CublasConvolution) [02/13/2023-19:54:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:26] [V] [TRT] --------------- Timing Runner: Conv_104 (CaskConvolution) [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0456869 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.029312 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0857417 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0246118 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0518735 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0161925 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0457703 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0541211 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0534918 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0536716 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0224581 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0166466 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0246354 [02/13/2023-19:54:26] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:26] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0855543 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0225574 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0491291 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0372743 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0352165 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0162123 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0181863 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0816823 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0261417 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0500907 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0290304 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0225574 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0372514 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.046016 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0160686 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0224764 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0824297 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.045752 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0527131 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0453691 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0847497 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.08168 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0353435 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0265661 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0176239 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.079984 [02/13/2023-19:54:27] [V] [TRT] Fastest Tactic: 0xba269390692faead Time: 0.0160686 [02/13/2023-19:54:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xba269390692faead [02/13/2023-19:54:27] [V] [TRT] *************** Autotuning format combination: Float(69120,1:4,3840,120) -> Float(16128,1:4,896,28) *************** [02/13/2023-19:54:27] [V] [TRT] --------------- Timing Runner: Conv_104 (CublasConvolution) [02/13/2023-19:54:27] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:27] [V] [TRT] --------------- Timing Runner: Conv_104 (CaskConvolution) [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0290697 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0247962 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0162585 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0224503 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0166537 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0245669 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0226377 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0372994 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0352722 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0161752 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0180697 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0260686 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0291529 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0225829 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.037256 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0160498 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0225045 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0354295 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.026653 [02/13/2023-19:54:27] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0179103 [02/13/2023-19:54:27] [V] [TRT] Fastest Tactic: 0xba269390692faead Time: 0.0160498 [02/13/2023-19:54:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xba269390692faead [02/13/2023-19:54:27] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:27] [V] [TRT] *************** Autotuning format combination: Float(64512,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:54:27] [V] [TRT] --------------- Timing Runner: Conv_105 (CudaDepthwiseConvolution) [02/13/2023-19:54:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:27] [V] [TRT] --------------- Timing Runner: Conv_105 (FusedConvActConvolution) [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.158441 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.127033 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.1196 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.116021 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000011ffff Time: 0.110663 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.120283 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.110789 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.120747 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000003cffff Time: 0.115214 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.115422 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000045ffff Time: 0.105568 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000046ffff Time: 0.108194 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000004affff Time: 0.115337 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.115358 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000004effff Time: 0.12072 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.113486 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000051ffff Time: 0.139934 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.117483 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.246418 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000059ffff Time: 0.112923 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000005effff Time: 0.110985 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000005fffff Time: 0.1108 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.125001 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.108363 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.17877 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.121586 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000006fffff Time: 0.115424 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.148096 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.116018 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.122329 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.123728 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000091ffff Time: 0.115376 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x00000000009dffff Time: 0.119209 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.111929 [02/13/2023-19:54:27] [V] [TRT] Fastest Tactic: 0x000000000045ffff Time: 0.105568 [02/13/2023-19:54:27] [V] [TRT] --------------- Timing Runner: Conv_105 (CudnnConvolution) [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0743863 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.037096 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.112393 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x0000000000000004 Time: 4.22446 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.437394 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0743954 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0375371 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000000003a Time: 0.113982 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000000003c Time: 4.21029 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x000000000000003d Time: 0.434816 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0744823 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0738811 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.111774 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x0000000000000074 Time: 4.24061 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.434496 [02/13/2023-19:54:27] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.037096 [02/13/2023-19:54:27] [V] [TRT] --------------- Timing Runner: Conv_105 (CublasConvolution) [02/13/2023-19:54:27] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:27] [V] [TRT] --------------- Timing Runner: Conv_105 (CaskConvolution) [02/13/2023-19:54:27] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0536183 [02/13/2023-19:54:27] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0641021 [02/13/2023-19:54:27] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0511467 [02/13/2023-19:54:27] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0747863 [02/13/2023-19:54:27] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0552518 [02/13/2023-19:54:27] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:27] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0290981 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.05632 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0570667 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0544808 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0813531 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0493897 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.061539 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.042776 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.062749 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0585249 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0561631 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0454389 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0530072 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0483718 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0283322 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0571703 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0559238 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.060387 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.054467 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.056573 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.0542217 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0270872 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.059555 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0483048 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0581181 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0503406 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.029771 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0611642 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0620343 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0495101 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0558187 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.100987 [02/13/2023-19:54:28] [V] [TRT] Fastest Tactic: 0xa419b3b68f2da07b Time: 0.0270872 [02/13/2023-19:54:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:28] [V] [TRT] *************** Autotuning format combination: Float(64512,1,3584,112) -> Float(387072,1,21504,672) *************** [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: Conv_105 (CublasConvolution) [02/13/2023-19:54:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: Conv_105 (CaskConvolution) [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0501836 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0200554 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0465943 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0338203 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0529356 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0287278 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0499596 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0610987 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.061091 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0537829 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0326391 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.029653 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0311753 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0468114 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0231536 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0459371 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0316288 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0209998 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0288713 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0331685 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0459954 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0438629 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0450594 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0195606 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.034987 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0324773 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0493912 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0290039 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0229695 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0712564 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0486705 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0595962 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.048928 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0477745 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0458549 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0208744 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.047472 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0311342 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0460434 [02/13/2023-19:54:28] [V] [TRT] Fastest Tactic: 0x9dece0dc37e90462 Time: 0.0195606 [02/13/2023-19:54:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:28] [V] [TRT] *************** Autotuning format combination: Float(16128,1:4,896,28) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: Conv_105 (CublasConvolution) [02/13/2023-19:54:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: Conv_105 (CaskConvolution) [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0200149 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0338039 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0285105 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0331767 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0291858 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0313362 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0232575 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0314715 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0208882 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.029237 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0328914 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0440229 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0197897 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0351653 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0325998 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0285516 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0231242 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0213277 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.04748 [02/13/2023-19:54:28] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0311799 [02/13/2023-19:54:28] [V] [TRT] Fastest Tactic: 0x9dece0dc37e90462 Time: 0.0197897 [02/13/2023-19:54:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:28] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:28] [V] [TRT] *************** Autotuning format combination: Float(387072,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_106), Mul_107) (PointWiseV2) [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0165171 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0128789 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0119802 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0115931 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0115014 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0111715 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0112577 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0114641 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0111311 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0119543 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0160701 [02/13/2023-19:54:28] [V] [TRT] Fastest Tactic: 0x0000000000000008 Time: 0.0111311 [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_106), Mul_107) (PointWise) [02/13/2023-19:54:28] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000008 [02/13/2023-19:54:28] [V] [TRT] *************** Autotuning format combination: Float(387072,1,21504,672) -> Float(387072,1,21504,672) *************** [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_106), Mul_107) (PointWiseV2) [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0165857 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0133211 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0114943 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0114465 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.011193 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0135838 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0114637 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0145111 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0114978 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0113315 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000001c Time: 0.016285 [02/13/2023-19:54:28] [V] [TRT] Fastest Tactic: 0x0000000000000004 Time: 0.011193 [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_106), Mul_107) (PointWise) [02/13/2023-19:54:28] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000004 [02/13/2023-19:54:28] [V] [TRT] *************** Autotuning format combination: Float(96768,1:4,5376,168) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_106), Mul_107) (PointWiseV2) [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0111346 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0115059 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0113354 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0112134 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0118115 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0127349 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0114792 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0131711 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0116927 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0119482 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0120964 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0112102 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0113871 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000000d Time: 0.011469 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0114975 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000000f Time: 0.011404 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0113596 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0130676 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0115696 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0113625 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0176625 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0143899 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0115478 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0116241 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0113224 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0119109 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0176615 [02/13/2023-19:54:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0111346 [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_106), Mul_107) (PointWise) [02/13/2023-19:54:28] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [02/13/2023-19:54:28] [V] [TRT] *************** Autotuning format combination: Float(12096,576:32,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_106), Mul_107) (PointWiseV2) [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0114785 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0114486 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0114581 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0114324 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0111793 [02/13/2023-19:54:28] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0111793 [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_106), Mul_107) (PointWise) [02/13/2023-19:54:28] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [02/13/2023-19:54:28] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_106), Mul_107) (PointWiseV2) [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.741545 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.941906 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.919305 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000003 Time: 1.31557 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.20728 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.877147 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000006 Time: 2.07817 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000007 Time: 1.5429 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000008 Time: 1.29227 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.36533 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000000a Time: 0.714171 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000000b Time: 0.864366 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000000c Time: 0.806651 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000000d Time: 1.11376 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000000e Time: 1.07136 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000000f Time: 0.797797 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000010 Time: 1.62285 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000011 Time: 1.38674 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000012 Time: 1.14101 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.985211 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.655209 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.837687 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000016 Time: 1.09153 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000017 Time: 1.62335 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0717211 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000001d Time: 0.072128 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0970377 [02/13/2023-19:54:28] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0717211 [02/13/2023-19:54:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:54:28] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:28] [V] [TRT] *************** Autotuning format combination: Float(387072,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: Conv_108 (CudaDepthwiseConvolution) [02/13/2023-19:54:28] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.0268488 [02/13/2023-19:54:28] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.0268488 [02/13/2023-19:54:28] [V] [TRT] --------------- Timing Runner: Conv_108 (CudnnConvolution) [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0687269 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0704899 [02/13/2023-19:54:28] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0616991 [02/13/2023-19:54:29] [V] [TRT] Tactic: 0x0000000000000004 Time: 31.7359 [02/13/2023-19:54:29] [V] [TRT] Tactic: 0x0000000000000005 Time: 37.305 [02/13/2023-19:54:29] [V] [TRT] Tactic: 0x0000000000000006 Time: 3.31093 [02/13/2023-19:54:29] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0626667 [02/13/2023-19:54:29] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0626606 [02/13/2023-19:54:29] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0614781 [02/13/2023-19:54:29] [V] [TRT] Tactic: 0x000000000000003c Time: 31.0464 [02/13/2023-19:54:30] [V] [TRT] Tactic: 0x000000000000003d Time: 37.1299 [02/13/2023-19:54:30] [V] [TRT] Tactic: 0x000000000000003e Time: 3.29637 [02/13/2023-19:54:30] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0636693 [02/13/2023-19:54:30] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0622933 [02/13/2023-19:54:30] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0616488 [02/13/2023-19:54:30] [V] [TRT] Tactic: 0x0000000000000074 Time: 31.8095 [02/13/2023-19:54:30] [V] [TRT] Tactic: 0x0000000000000075 Time: 36.5725 [02/13/2023-19:54:30] [V] [TRT] Tactic: 0x0000000000000076 Time: 3.28031 [02/13/2023-19:54:30] [V] [TRT] Fastest Tactic: 0x000000000000003a Time: 0.0614781 [02/13/2023-19:54:30] [V] [TRT] --------------- Timing Runner: Conv_108 (CaskConvolution) [02/13/2023-19:54:31] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:54:31] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 7.67421 [02/13/2023-19:54:31] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:54:31] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 8.27334 [02/13/2023-19:54:31] [V] [TRT] Conv_108 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:31] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 7.70429 [02/13/2023-19:54:31] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:54:31] [V] [TRT] Tactic: 0x4727434768e46395 Time: 5.27584 [02/13/2023-19:54:31] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:54:31] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 15.5355 [02/13/2023-19:54:31] [V] [TRT] Conv_108 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:31] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 8.76263 [02/13/2023-19:54:31] [V] [TRT] Conv_108 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:54:31] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 8.89355 [02/13/2023-19:54:31] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:54:32] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 7.9616 [02/13/2023-19:54:32] [V] [TRT] Conv_108 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:54:32] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 7.87002 [02/13/2023-19:54:32] [V] [TRT] Conv_108 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:54:32] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 6.05021 [02/13/2023-19:54:32] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:54:32] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 5.37904 [02/13/2023-19:54:32] [V] [TRT] Conv_108 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:32] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 7.63716 [02/13/2023-19:54:32] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:54:32] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 16.2795 [02/13/2023-19:54:32] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:54:32] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 5.89462 [02/13/2023-19:54:32] [V] [TRT] Conv_108 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:32] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 8.84924 [02/13/2023-19:54:33] [V] [TRT] Conv_108 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:33] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 7.96262 [02/13/2023-19:54:33] [V] [TRT] Fastest Tactic: 0x4727434768e46395 Time: 5.27584 [02/13/2023-19:54:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 0xffffffffffffffff [02/13/2023-19:54:33] [V] [TRT] *************** Autotuning format combination: Float(387072,1,21504,672) -> Float(387072,1,21504,672) *************** [02/13/2023-19:54:33] [V] [TRT] --------------- Timing Runner: Conv_108 (CaskConvolution) [02/13/2023-19:54:33] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:54:33] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 7.35957 [02/13/2023-19:54:33] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:54:33] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 10.4454 [02/13/2023-19:54:33] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:54:33] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 18.5503 [02/13/2023-19:54:33] [V] [TRT] Conv_108 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf2 [02/13/2023-19:54:33] [V] [TRT] Tactic: 0x5030121339a48bf2 Time: 2.79918 [02/13/2023-19:54:33] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:54:33] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 7.39046 [02/13/2023-19:54:33] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:54:33] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 17.8405 [02/13/2023-19:54:33] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 7.26581 [02/13/2023-19:54:34] [V] [TRT] Conv_108 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d739 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xca7eeb8d9143d739 Time: 2.8461 [02/13/2023-19:54:34] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 10.0796 [02/13/2023-19:54:34] [V] [TRT] Conv_108 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf50 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xd9031472c05adf50 Time: 2.81472 [02/13/2023-19:54:34] [V] [TRT] Conv_108 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 10.2326 [02/13/2023-19:54:34] [V] [TRT] Fastest Tactic: 0x5030121339a48bf2 Time: 2.79918 [02/13/2023-19:54:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5030121339a48bf2 [02/13/2023-19:54:34] [V] [TRT] *************** Autotuning format combination: Float(96768,1:4,5376,168) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:54:34] [V] [TRT] --------------- Timing Runner: Conv_108 (CaskConvolution) [02/13/2023-19:54:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:34] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:34] [V] [TRT] *************** Autotuning format combination: Float(387072,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:54:34] [V] [TRT] *************** Autotuning format combination: Float(387072,1,21504,672) -> Float(387072,1,21504,672) *************** [02/13/2023-19:54:34] [V] [TRT] *************** Autotuning format combination: Float(96768,1:4,5376,168) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:54:34] [V] [TRT] *************** Autotuning format combination: Float(12096,576:32,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:54:34] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:34] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:34] [V] [TRT] *************** Autotuning format combination: Float(387072,576,32,1) -> Float(672,1,1,1) *************** [02/13/2023-19:54:34] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_111 (TiledPooling) [02/13/2023-19:54:34] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [02/13/2023-19:54:34] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_111 (CudnnPooling) [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00974507 [02/13/2023-19:54:34] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00974507 [02/13/2023-19:54:34] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_111 (CaskPooling) [02/13/2023-19:54:34] [V] [TRT] GlobalAveragePool_111 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Average_FastDiv Tactic: 0x933eceba7b866d59 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x933eceba7b866d59 Time: 0.00995749 [02/13/2023-19:54:34] [V] [TRT] Fastest Tactic: 0x933eceba7b866d59 Time: 0.00995749 [02/13/2023-19:54:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: 0xffffffffffffffff [02/13/2023-19:54:34] [V] [TRT] *************** Autotuning format combination: Float(96768,1:4,5376,168) -> Float(168,1:4,168,168) *************** [02/13/2023-19:54:34] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_111 (CaskPooling) [02/13/2023-19:54:34] [V] [TRT] GlobalAveragePool_111 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Average_FastDiv_CAlign4 Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xfab3e2ee1c085a9a Time: 0.0138452 [02/13/2023-19:54:34] [V] [TRT] Fastest Tactic: 0xfab3e2ee1c085a9a Time: 0.0138452 [02/13/2023-19:54:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:54:34] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:34] [V] [TRT] *************** Autotuning format combination: Float(672,1,1,1) -> Float(168,1,1,1) *************** [02/13/2023-19:54:34] [V] [TRT] --------------- Timing Runner: Conv_112 + Relu_113 (CudaDepthwiseConvolution) [02/13/2023-19:54:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:34] [V] [TRT] --------------- Timing Runner: Conv_112 + Relu_113 (FusedConvActConvolution) [02/13/2023-19:54:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:34] [V] [TRT] --------------- Timing Runner: Conv_112 + Relu_113 (CudnnConvolution) [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.050755 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0179646 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.094608 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 2.00551 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.304658 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0517623 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.01779 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0951451 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x000000000000003c Time: 1.99662 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x000000000000003d Time: 0.306889 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0514712 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0521829 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0949006 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000074 Time: 2.01196 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.305061 [02/13/2023-19:54:34] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.01779 [02/13/2023-19:54:34] [V] [TRT] --------------- Timing Runner: Conv_112 + Relu_113 (CublasConvolution) [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0115474 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0116846 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0119935 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.012117 [02/13/2023-19:54:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0115474 [02/13/2023-19:54:34] [V] [TRT] --------------- Timing Runner: Conv_112 + Relu_113 (CaskConvolution) [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0287168 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.018132 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0308416 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.018772 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0452171 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0627947 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.131497 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0327195 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0880983 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0454251 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.112699 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0759223 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0518293 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0515642 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0393074 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0495375 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.026611 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0219135 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0537448 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0433417 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0741966 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0430869 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0705585 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0980548 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0664731 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.129849 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.042584 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.101634 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.110645 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xaa0953b1a73b0b9b Time: 0.00791338 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0681996 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0837189 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0637013 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0709272 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0222766 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.114891 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0933006 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.228293 [02/13/2023-19:54:34] [V] [TRT] Fastest Tactic: 0xaa0953b1a73b0b9b Time: 0.00791338 [02/13/2023-19:54:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:34] [V] [TRT] *************** Autotuning format combination: Float(672,1,672,672) -> Float(168,1,168,168) *************** [02/13/2023-19:54:34] [V] [TRT] --------------- Timing Runner: Conv_112 + Relu_113 (CublasConvolution) [02/13/2023-19:54:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:34] [V] [TRT] --------------- Timing Runner: Conv_112 + Relu_113 (CaskConvolution) [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0600107 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0310903 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.110878 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0308151 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0686613 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0202771 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0584091 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0398229 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0410411 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0685486 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0158117 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0202189 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0304466 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.11144 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0266415 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0370686 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0453966 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0435737 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0201754 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.020396 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.109282 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0136935 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0371771 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:34] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0305829 [02/13/2023-19:54:34] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0159309 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0454766 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0604343 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0203017 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0265821 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.100423 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0580602 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0392126 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0581486 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.113589 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.109575 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0447017 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0138751 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0203091 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.107433 [02/13/2023-19:54:35] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.0136935 [02/13/2023-19:54:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:54:35] [V] [TRT] *************** Autotuning format combination: Float(168,1:4,168,168) -> Float(42,1:4,42,42) *************** [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: Conv_112 + Relu_113 (CublasConvolution) [02/13/2023-19:54:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: Conv_112 + Relu_113 (CaskConvolution) [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0309833 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0307401 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0200469 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.015744 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.020104 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0306597 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0266484 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.045528 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0435851 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0203149 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0204121 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0137151 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0308261 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0159451 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0454366 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0202537 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0266293 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0439909 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0136985 [02/13/2023-19:54:35] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0203829 [02/13/2023-19:54:35] [V] [TRT] Fastest Tactic: 0xed09dcddfcf4bffb Time: 0.0136985 [02/13/2023-19:54:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:35] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:35] [V] [TRT] *************** Autotuning format combination: Float(168,1,1,1) -> Float(672,1,1,1) *************** [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: Conv_114 (CudaDepthwiseConvolution) [02/13/2023-19:54:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: Conv_114 (FusedConvActConvolution) [02/13/2023-19:54:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: Conv_114 (CudnnConvolution) [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0190731 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.019128 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0518293 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000004 Time: 2.03952 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.397696 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0191349 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0191446 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0520594 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x000000000000003c Time: 2.03729 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x000000000000003d Time: 0.399817 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0192034 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0191223 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0519116 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000074 Time: 2.03752 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.399511 [02/13/2023-19:54:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0190731 [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: Conv_114 (CublasConvolution) [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0115995 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0223484 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0116564 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0218834 [02/13/2023-19:54:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0115995 [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: Conv_114 (CaskConvolution) [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0180023 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0162458 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0178851 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0182011 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0162555 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.03088 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0453634 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0188486 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0303954 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0248754 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0370834 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0368686 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0265821 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0261486 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0203086 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.024403 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0160152 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0135215 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0286455 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.022449 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0349961 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0160132 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0249128 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0328238 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0244815 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.0435691 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0221309 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0329143 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0368286 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xaa0953b1a73b0b9b Time: 0.00702977 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0245211 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0288146 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0312795 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0265524 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0139391 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0369497 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0308837 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0692526 [02/13/2023-19:54:35] [V] [TRT] Fastest Tactic: 0xaa0953b1a73b0b9b Time: 0.00702977 [02/13/2023-19:54:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:35] [V] [TRT] *************** Autotuning format combination: Float(168,1,168,168) -> Float(672,1,672,672) *************** [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: Conv_114 (CublasConvolution) [02/13/2023-19:54:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: Conv_114 (CaskConvolution) [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0221055 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0142982 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0349714 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0156951 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0243505 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0115453 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.022402 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0284823 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0286043 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0245691 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00941229 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0113459 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0140796 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.035072 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0139512 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0154194 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0202366 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0206635 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0116462 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0116898 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.034987 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0118207 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0144105 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0140858 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.00957653 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0204173 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0225267 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0115334 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0139778 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0365897 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0210795 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.026832 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.02048 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0352457 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0349595 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.02022 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0130535 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0116898 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0342464 [02/13/2023-19:54:35] [V] [TRT] Fastest Tactic: 0x46e3f4ab19d1017d Time: 0.00941229 [02/13/2023-19:54:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:35] [V] [TRT] *************** Autotuning format combination: Float(42,1:4,42,42) -> Float(168,1:4,168,168) *************** [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: Conv_114 (CublasConvolution) [02/13/2023-19:54:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: Conv_114 (CaskConvolution) [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0141964 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0156567 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0113607 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00928514 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0112594 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0139753 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0140476 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0204376 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0203731 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0115938 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0116185 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0117802 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0141253 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.00949886 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0204023 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xba269390692faead Time: 0.011705 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0139844 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0203 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0129463 [02/13/2023-19:54:35] [V] [TRT] Conv_114 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0116378 [02/13/2023-19:54:35] [V] [TRT] Fastest Tactic: 0x46e3f4ab19d1017d Time: 0.00928514 [02/13/2023-19:54:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:35] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:35] [V] [TRT] *************** Autotuning format combination: Float(672,1,1,1), Float(387072,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_115), Mul_116) (PointWiseV2) [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0265844 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0329216 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0305563 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0390309 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0407749 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.03616 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0508861 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0492648 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0491017 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0490712 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0262362 [02/13/2023-19:54:35] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0262362 [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_115), Mul_116) (PointWise) [02/13/2023-19:54:35] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:54:35] [V] [TRT] *************** Autotuning format combination: Float(672,1,672,672), Float(387072,1,21504,672) -> Float(387072,1,21504,672) *************** [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_115), Mul_116) (PointWiseV2) [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0323374 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.02288 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0213309 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0168411 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0172221 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0164444 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.013814 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0134466 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0129429 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.013322 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0311451 [02/13/2023-19:54:35] [V] [TRT] Fastest Tactic: 0x0000000000000008 Time: 0.0129429 [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_115), Mul_116) (PointWise) [02/13/2023-19:54:35] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000008 [02/13/2023-19:54:35] [V] [TRT] *************** Autotuning format combination: Float(168,1:4,168,168), Float(96768,1:4,5376,168) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:54:35] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_115), Mul_116) (PointWiseV2) [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0242606 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0249562 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0342107 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0254278 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0309714 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0421703 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0254568 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0310491 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.034219 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.045352 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0241981 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0228251 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0249326 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0232418 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0256411 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0342528 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0238545 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0269173 [02/13/2023-19:54:35] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0313829 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0417783 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0346542 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0253737 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0193794 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0152882 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0247497 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0227461 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0344603 [02/13/2023-19:54:36] [V] [TRT] Fastest Tactic: 0x0000000000000017 Time: 0.0152882 [02/13/2023-19:54:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_115), Mul_116) (PointWise) [02/13/2023-19:54:36] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000017 [02/13/2023-19:54:36] [V] [TRT] *************** Autotuning format combination: Float(21,1:32,1,1), Float(12096,576:32,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:54:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_115), Mul_116) (PointWiseV2) [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0243756 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0248571 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0252198 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0247352 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000001f Time: 0.024992 [02/13/2023-19:54:36] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.0243756 [02/13/2023-19:54:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_115), Mul_116) (PointWise) [02/13/2023-19:54:36] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [02/13/2023-19:54:36] [V] [TRT] *************** Autotuning format combination: Float(1:4,1,1,1), Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_115), Mul_116) (PointWiseV2) [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.23333 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000001 Time: 1.51861 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000002 Time: 1.4798 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000003 Time: 1.99128 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.9784 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.46444 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000006 Time: 2.93925 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000007 Time: 2.48924 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000008 Time: 2.66396 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000009 Time: 2.05438 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000000a Time: 1.12726 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000000b Time: 1.42317 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000000c Time: 1.22435 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000000d Time: 1.77768 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000000e Time: 1.69084 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000000f Time: 1.24395 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000010 Time: 2.49982 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000011 Time: 2.05697 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000012 Time: 2.13409 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000013 Time: 1.40849 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.991401 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000015 Time: 1.27368 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000016 Time: 1.55364 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000017 Time: 2.12373 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000001c Time: 0.096336 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0899246 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000001e Time: 0.133285 [02/13/2023-19:54:36] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.0899246 [02/13/2023-19:54:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [02/13/2023-19:54:36] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:36] [V] [TRT] *************** Autotuning format combination: Float(387072,576,32,1), Float(64512,576,32,1) -> Float(64512,576,32,1) *************** [02/13/2023-19:54:36] [V] [TRT] --------------- Timing Runner: Conv_117 + Add_118 (CudaDepthwiseConvolution) [02/13/2023-19:54:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:36] [V] [TRT] --------------- Timing Runner: Conv_117 + Add_118 (FusedConvActConvolution) [02/13/2023-19:54:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:36] [V] [TRT] --------------- Timing Runner: Conv_117 + Add_118 (CudnnConvolution) [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.091264 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0870446 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.251186 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000004 Time: 4.12066 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.493221 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0916229 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0870491 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000003a Time: 0.224009 [02/13/2023-19:54:36] [V] [TRT] Tactic: 0x000000000000003c Time: 4.13062 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x000000000000003d Time: 0.496133 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0917394 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0867611 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.27461 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x0000000000000074 Time: 4.12115 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.491977 [02/13/2023-19:54:37] [V] [TRT] Fastest Tactic: 0x0000000000000071 Time: 0.0867611 [02/13/2023-19:54:37] [V] [TRT] --------------- Timing Runner: Conv_117 + Add_118 (CublasConvolution) [02/13/2023-19:54:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:37] [V] [TRT] --------------- Timing Runner: Conv_117 + Add_118 (CaskConvolution) [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.030816 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0497387 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0348297 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.052352 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.074928 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0781143 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.139691 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0370914 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0898217 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0497722 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.115584 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0876114 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0656076 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0560015 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.043376 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0539977 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0307694 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0414789 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0662781 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0584427 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.087088 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0753234 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0725897 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.106837 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0685943 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.139291 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0582674 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.111899 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.114535 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0701531 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.085584 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0772434 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0728663 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0445074 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.116752 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0937806 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.237696 [02/13/2023-19:54:37] [V] [TRT] Fastest Tactic: 0x5f5015dbf902f0a3 Time: 0.0307694 [02/13/2023-19:54:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:37] [V] [TRT] *************** Autotuning format combination: Float(387072,1,21504,672), Float(64512,1,3584,112) -> Float(64512,1,3584,112) *************** [02/13/2023-19:54:37] [V] [TRT] --------------- Timing Runner: Conv_117 + Add_118 (CublasConvolution) [02/13/2023-19:54:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:37] [V] [TRT] --------------- Timing Runner: Conv_117 + Add_118 (CaskConvolution) [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0622019 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0387966 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.116496 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0327653 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0719931 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0203823 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0619474 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0721211 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.07288 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0725783 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0280236 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0206622 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0310098 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.116754 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0289015 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0655299 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0482103 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.047568 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0210697 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0224496 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.111463 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0328311 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.06704 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0376766 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0287003 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0492282 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0620907 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xba269390692faead Time: 0.020576 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0286482 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.110761 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0614202 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0707352 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0610545 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.115099 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.111886 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0476678 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0327141 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0220571 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.109774 [02/13/2023-19:54:37] [V] [TRT] Fastest Tactic: 0x2b4a5a2f546acbfd Time: 0.0203823 [02/13/2023-19:54:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:37] [V] [TRT] *************** Autotuning format combination: Float(96768,1:4,5376,168), Float(16128,1:4,896,28) -> Float(16128,1:4,896,28) *************** [02/13/2023-19:54:37] [V] [TRT] --------------- Timing Runner: Conv_117 + Add_118 (CublasConvolution) [02/13/2023-19:54:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:37] [V] [TRT] --------------- Timing Runner: Conv_117 + Add_118 (CaskConvolution) [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0388766 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0327845 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0206661 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.027267 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0210456 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0311808 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0288155 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0490941 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0475394 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0212918 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0222798 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.032992 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.037472 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0287534 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.049603 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0204637 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0287214 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0476046 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0329792 [02/13/2023-19:54:37] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0218821 [02/13/2023-19:54:37] [V] [TRT] Fastest Tactic: 0xba269390692faead Time: 0.0204637 [02/13/2023-19:54:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xba269390692faead [02/13/2023-19:54:37] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:37] [V] [TRT] *************** Autotuning format combination: Float(64512,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:54:37] [V] [TRT] *************** Autotuning format combination: Float(64512,1,3584,112) -> Float(387072,1,21504,672) *************** [02/13/2023-19:54:37] [V] [TRT] *************** Autotuning format combination: Float(16128,1:4,896,28) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:54:37] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:37] [V] [TRT] *************** Autotuning format combination: Float(387072,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:54:37] [V] [TRT] *************** Autotuning format combination: Float(387072,1,21504,672) -> Float(387072,1,21504,672) *************** [02/13/2023-19:54:37] [V] [TRT] *************** Autotuning format combination: Float(96768,1:4,5376,168) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:54:37] [V] [TRT] *************** Autotuning format combination: Float(12096,576:32,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:54:37] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:37] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:37] [V] [TRT] *************** Autotuning format combination: Float(387072,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:54:37] [V] [TRT] --------------- Timing Runner: Conv_122 (CudaDepthwiseConvolution) [02/13/2023-19:54:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:37] [V] [TRT] --------------- Timing Runner: Conv_122 (CudnnConvolution) [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.118055 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.1172 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.117602 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.118073 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.121422 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x000000000000003a Time: 0.117223 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.117426 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.117179 [02/13/2023-19:54:37] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.120027 [02/13/2023-19:54:37] [V] [TRT] Fastest Tactic: 0x0000000000000071 Time: 0.117179 [02/13/2023-19:54:37] [V] [TRT] --------------- Timing Runner: Conv_122 (CaskConvolution) [02/13/2023-19:54:37] [V] [TRT] Conv_122 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:54:38] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 9.22913 [02/13/2023-19:54:38] [V] [TRT] Conv_122 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:54:38] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 11.6048 [02/13/2023-19:54:38] [V] [TRT] Conv_122 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:54:38] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 8.80125 [02/13/2023-19:54:38] [V] [TRT] Conv_122 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:54:38] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 10.0443 [02/13/2023-19:54:38] [V] [TRT] Conv_122 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r5s5_aligna4_alignc4 Tactic: 0x967f94e9db2001a8 [02/13/2023-19:54:38] [V] [TRT] Tactic: 0x967f94e9db2001a8 Time: 5.81215 [02/13/2023-19:54:38] [V] [TRT] Conv_122 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:54:38] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 5.93086 [02/13/2023-19:54:38] [V] [TRT] Conv_122 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:54:38] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 19.7846 [02/13/2023-19:54:38] [V] [TRT] Conv_122 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:54:39] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 7.22155 [02/13/2023-19:54:39] [V] [TRT] Conv_122 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:39] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 11.5482 [02/13/2023-19:54:39] [V] [TRT] Conv_122 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:39] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 10.3036 [02/13/2023-19:54:39] [V] [TRT] Fastest Tactic: 0x967f94e9db2001a8 Time: 5.81215 [02/13/2023-19:54:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000071 [02/13/2023-19:54:39] [V] [TRT] *************** Autotuning format combination: Float(387072,1,21504,672) -> Float(387072,1,21504,672) *************** [02/13/2023-19:54:39] [V] [TRT] --------------- Timing Runner: Conv_122 (CaskConvolution) [02/13/2023-19:54:39] [V] [TRT] Conv_122 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:54:39] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 11.8803 [02/13/2023-19:54:39] [V] [TRT] Conv_122 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:54:39] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 17.0431 [02/13/2023-19:54:39] [V] [TRT] Conv_122 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r5s5_aligna4_alignc4 Tactic: 0x45ff0c3a09b02e78 [02/13/2023-19:54:39] [V] [TRT] Tactic: 0x45ff0c3a09b02e78 Time: 11.257 [02/13/2023-19:54:39] [V] [TRT] Conv_122 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:54:39] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 11.5906 [02/13/2023-19:54:40] [V] [TRT] Conv_122 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 29.7054 [02/13/2023-19:54:40] [V] [TRT] Conv_122 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d739 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0xca7eeb8d9143d739 Time: 7.09554 [02/13/2023-19:54:40] [V] [TRT] Conv_122 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf50 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0xd9031472c05adf50 Time: 7.05975 [02/13/2023-19:54:40] [V] [TRT] Fastest Tactic: 0xd9031472c05adf50 Time: 7.05975 [02/13/2023-19:54:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd9031472c05adf50 [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(96768,1:4,5376,168) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:54:40] [V] [TRT] --------------- Timing Runner: Conv_122 (CaskConvolution) [02/13/2023-19:54:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:40] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(387072,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(387072,1,21504,672) -> Float(387072,1,21504,672) *************** [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(96768,1:4,5376,168) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(12096,576:32,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:40] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(387072,576,32,1) -> Float(672,1,1,1) *************** [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(96768,1:4,5376,168) -> Float(168,1:4,168,168) *************** [02/13/2023-19:54:40] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(672,1,1,1) -> Float(168,1,1,1) *************** [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(672,1,672,672) -> Float(168,1,168,168) *************** [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(168,1:4,168,168) -> Float(42,1:4,42,42) *************** [02/13/2023-19:54:40] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(168,1,1,1) -> Float(672,1,1,1) *************** [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(168,1,168,168) -> Float(672,1,672,672) *************** [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(42,1:4,42,42) -> Float(168,1:4,168,168) *************** [02/13/2023-19:54:40] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(672,1,1,1), Float(387072,576,32,1) -> Float(387072,576,32,1) *************** [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(672,1,672,672), Float(387072,1,21504,672) -> Float(387072,1,21504,672) *************** [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(168,1:4,168,168), Float(96768,1:4,5376,168) -> Float(96768,1:4,5376,168) *************** [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(21,1:32,1,1), Float(12096,576:32,32,1) -> Float(12096,576:32,32,1) *************** [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(1:4,1,1,1), Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:40] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:40] [V] [TRT] *************** Autotuning format combination: Float(387072,576,32,1) -> Float(92160,576,32,1) *************** [02/13/2023-19:54:40] [V] [TRT] --------------- Timing Runner: Conv_131 (CudaDepthwiseConvolution) [02/13/2023-19:54:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:40] [V] [TRT] --------------- Timing Runner: Conv_131 (FusedConvActConvolution) [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.20992 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.152576 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.122544 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.129575 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000011ffff Time: 0.0931017 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.11285 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000001fffff Time: 0.108098 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.102759 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.138699 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000003cffff Time: 0.116718 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.10752 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000040ffff Time: 0.104661 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000045ffff Time: 0.0992183 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000046ffff Time: 0.100306 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000004affff Time: 0.107449 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.108082 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000004effff Time: 0.110949 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.105415 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000051ffff Time: 0.139527 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.164073 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.290427 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000059ffff Time: 0.103262 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000005effff Time: 0.105449 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000005fffff Time: 0.0934491 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.122949 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000006affff Time: 0.109127 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.0833714 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.182107 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.0984891 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000006fffff Time: 0.10656 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.20811 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.119527 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.133605 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.130686 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000008affff Time: 0.117138 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000091ffff Time: 0.107785 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x00000000009dffff Time: 0.112715 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.111451 [02/13/2023-19:54:40] [V] [TRT] Fastest Tactic: 0x00000000006bffff Time: 0.0833714 [02/13/2023-19:54:40] [V] [TRT] --------------- Timing Runner: Conv_131 (CudnnConvolution) [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0886926 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.115646 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.185454 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x0000000000000004 Time: 5.96437 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.71371 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0887657 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.115557 [02/13/2023-19:54:40] [V] [TRT] Tactic: 0x000000000000003a Time: 0.223269 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x000000000000003c Time: 5.93199 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x000000000000003d Time: 0.714565 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0885783 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0883634 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.201371 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x0000000000000074 Time: 5.93997 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.714839 [02/13/2023-19:54:41] [V] [TRT] Fastest Tactic: 0x0000000000000071 Time: 0.0883634 [02/13/2023-19:54:41] [V] [TRT] --------------- Timing Runner: Conv_131 (CublasConvolution) [02/13/2023-19:54:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:41] [V] [TRT] --------------- Timing Runner: Conv_131 (CaskConvolution) [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0538773 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0475474 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0327762 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.051261 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0748023 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0686629 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.133065 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0350857 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.08864 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0485425 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.11389 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0790629 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0540891 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0544579 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.041256 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0520411 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0496838 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0408377 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0557364 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0475909 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0772777 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0749851 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0714834 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.10659 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.121278 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.131664 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.047448 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.109502 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.113392 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.124103 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0848114 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0688457 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0719634 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0432183 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.115413 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0920937 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.229865 [02/13/2023-19:54:41] [V] [TRT] Fastest Tactic: 0x1016909b1fd6ff2f Time: 0.0327762 [02/13/2023-19:54:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:41] [V] [TRT] *************** Autotuning format combination: Float(387072,1,21504,672) -> Float(92160,1,5120,160) *************** [02/13/2023-19:54:41] [V] [TRT] --------------- Timing Runner: Conv_131 (CublasConvolution) [02/13/2023-19:54:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:41] [V] [TRT] --------------- Timing Runner: Conv_131 (CaskConvolution) [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.10965 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0370926 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.115241 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0309723 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0692739 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0201943 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0602926 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.070912 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0720983 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0711086 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0266179 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0203526 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0309038 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.116533 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0287141 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0650545 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0475669 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.045384 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0370206 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0221669 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.110777 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.032736 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0652571 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.037104 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0286117 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0472777 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0612373 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0358069 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0278895 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.107685 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.108505 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0692389 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0597623 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.114617 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.110606 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0455166 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0328311 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0203263 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.108507 [02/13/2023-19:54:41] [V] [TRT] Fastest Tactic: 0x2b4a5a2f546acbfd Time: 0.0201943 [02/13/2023-19:54:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:41] [V] [TRT] *************** Autotuning format combination: Float(96768,1:4,5376,168) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:54:41] [V] [TRT] --------------- Timing Runner: Conv_131 (CublasConvolution) [02/13/2023-19:54:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:41] [V] [TRT] --------------- Timing Runner: Conv_131 (CaskConvolution) [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0371509 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0308754 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0203531 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.026659 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0204211 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0307365 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0285751 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0475451 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0454766 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0366823 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0222426 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0325458 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.037008 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0286793 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0475303 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0360514 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0279863 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0455051 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0329243 [02/13/2023-19:54:41] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:41] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0203857 [02/13/2023-19:54:41] [V] [TRT] Fastest Tactic: 0x2b4a5a2f546acbfd Time: 0.0203531 [02/13/2023-19:54:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:41] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:41] [V] [TRT] *************** Autotuning format combination: Float(92160,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:54:41] [V] [TRT] --------------- Timing Runner: Conv_132 (CudaDepthwiseConvolution) [02/13/2023-19:54:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:41] [V] [TRT] --------------- Timing Runner: Conv_132 (FusedConvActConvolution) [02/13/2023-19:54:41] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.267598 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.180315 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.196302 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.179442 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000011ffff Time: 0.167333 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.202011 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000001fffff Time: 0.207593 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.167973 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.180759 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000003cffff Time: 0.195077 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.184969 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000040ffff Time: 0.186491 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000045ffff Time: 0.165938 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000046ffff Time: 0.169664 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000004affff Time: 0.188023 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.182542 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000004effff Time: 0.186418 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.169765 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000051ffff Time: 0.235013 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.186752 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.464069 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000059ffff Time: 0.177303 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000005effff Time: 0.171415 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000005fffff Time: 0.16773 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.20059 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000006affff Time: 0.206885 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.161545 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.298949 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.186249 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000006fffff Time: 0.188123 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.257979 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.182638 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.212251 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.206313 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000008affff Time: 0.217202 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000091ffff Time: 0.192873 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x00000000009dffff Time: 0.197321 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.171291 [02/13/2023-19:54:42] [V] [TRT] Fastest Tactic: 0x00000000006bffff Time: 0.161545 [02/13/2023-19:54:42] [V] [TRT] --------------- Timing Runner: Conv_132 (CudnnConvolution) [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.131063 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0572937 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.180933 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x0000000000000004 Time: 8.54034 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.766295 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.131886 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.050947 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000000003a Time: 0.178679 [02/13/2023-19:54:42] [V] [TRT] Tactic: 0x000000000000003c Time: 8.53877 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x000000000000003d Time: 0.766117 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.127845 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.127481 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.197984 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000074 Time: 8.54967 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.765883 [02/13/2023-19:54:43] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.050947 [02/13/2023-19:54:43] [V] [TRT] --------------- Timing Runner: Conv_132 (CublasConvolution) [02/13/2023-19:54:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:43] [V] [TRT] --------------- Timing Runner: Conv_132 (CaskConvolution) [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0706636 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.114258 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0706164 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.126759 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0893691 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0568335 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.133584 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0754011 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.087696 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.116683 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0913897 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0735886 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0693074 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0711421 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0865463 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0627901 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0586667 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0837257 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0768503 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0527741 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0643139 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0937371 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.106215 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0894354 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0965097 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.137769 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.046496 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0973189 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0904571 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.09384 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0814354 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0582766 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.100224 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.09504 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0927177 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0892091 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.132894 [02/13/2023-19:54:43] [V] [TRT] Fastest Tactic: 0xa419b3b68f2da07b Time: 0.046496 [02/13/2023-19:54:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:43] [V] [TRT] *************** Autotuning format combination: Float(92160,1,5120,160) -> Float(552960,1,30720,960) *************** [02/13/2023-19:54:43] [V] [TRT] --------------- Timing Runner: Conv_132 (CublasConvolution) [02/13/2023-19:54:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:43] [V] [TRT] --------------- Timing Runner: Conv_132 (CaskConvolution) [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0789714 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0345591 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0885531 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0388103 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0856709 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0393703 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0761051 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.09656 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0956914 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0861257 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0506133 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0433577 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0378366 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.091712 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0354926 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0745486 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0375817 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0398823 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0392823 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0469703 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.086752 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.07576 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0738286 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0325303 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0533623 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0410217 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0779977 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0387394 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0384617 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.116327 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0757714 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.094576 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0752686 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0897303 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0861486 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.037656 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0802491 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0423383 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.08608 [02/13/2023-19:54:43] [V] [TRT] Fastest Tactic: 0x9dece0dc37e90462 Time: 0.0325303 [02/13/2023-19:54:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:43] [V] [TRT] *************** Autotuning format combination: Float(23040,1:4,1280,40) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:54:43] [V] [TRT] --------------- Timing Runner: Conv_132 (CublasConvolution) [02/13/2023-19:54:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:43] [V] [TRT] --------------- Timing Runner: Conv_132 (CaskConvolution) [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0321307 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.041416 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0388811 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0503284 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.042984 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0362057 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0354523 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0374949 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0370629 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0393177 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0475851 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0723337 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0321719 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0537448 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.039608 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xba269390692faead Time: 0.038496 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0343269 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0374857 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0778651 [02/13/2023-19:54:43] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0420183 [02/13/2023-19:54:43] [V] [TRT] Fastest Tactic: 0x130df49cb195156b Time: 0.0321307 [02/13/2023-19:54:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x130df49cb195156b [02/13/2023-19:54:43] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:43] [V] [TRT] *************** Autotuning format combination: Float(552960,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:54:43] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_133), Mul_134) (PointWiseV2) [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0314039 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0238354 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0244213 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.025587 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0242987 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.023262 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0265036 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.024147 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0237995 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.025437 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0300535 [02/13/2023-19:54:43] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.023262 [02/13/2023-19:54:43] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_133), Mul_134) (PointWise) [02/13/2023-19:54:43] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:54:43] [V] [TRT] *************** Autotuning format combination: Float(552960,1,30720,960) -> Float(552960,1,30720,960) *************** [02/13/2023-19:54:43] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_133), Mul_134) (PointWiseV2) [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.032757 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0262949 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0263429 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0251451 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0251406 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0232895 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0288155 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0242484 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0244846 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0267566 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0303689 [02/13/2023-19:54:43] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.0232895 [02/13/2023-19:54:43] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_133), Mul_134) (PointWise) [02/13/2023-19:54:43] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:54:43] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,7680,240) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:54:43] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_133), Mul_134) (PointWiseV2) [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0242872 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0268853 [02/13/2023-19:54:43] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.02352 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0271931 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0245143 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0236428 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0252389 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0252655 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0254789 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0266133 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0240411 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000000b Time: 0.026221 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0238949 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0259444 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0234782 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0247992 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0248099 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0250926 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.025424 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0229734 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0349129 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0266149 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0260008 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0268884 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0234691 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0261349 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0309678 [02/13/2023-19:54:44] [V] [TRT] Fastest Tactic: 0x0000000000000013 Time: 0.0229734 [02/13/2023-19:54:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_133), Mul_134) (PointWise) [02/13/2023-19:54:44] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000013 [02/13/2023-19:54:44] [V] [TRT] *************** Autotuning format combination: Float(17280,576:32,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:54:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_133), Mul_134) (PointWiseV2) [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.026899 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0228656 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0249691 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000001b Time: 0.024176 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0250263 [02/13/2023-19:54:44] [V] [TRT] Fastest Tactic: 0x0000000000000019 Time: 0.0228656 [02/13/2023-19:54:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_133), Mul_134) (PointWise) [02/13/2023-19:54:44] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000019 [02/13/2023-19:54:44] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_133), Mul_134) (PointWiseV2) [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.05615 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 1.34146 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000002 Time: 1.30961 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000003 Time: 1.87616 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.72201 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.25035 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000006 Time: 2.96553 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000007 Time: 2.20141 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000008 Time: 1.84268 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.94902 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000000a Time: 1.01823 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000000b Time: 1.23196 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000000c Time: 1.15062 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000000d Time: 1.58821 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000000e Time: 1.52803 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000000f Time: 1.13629 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000010 Time: 2.31644 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000011 Time: 1.97931 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000012 Time: 1.62784 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000013 Time: 1.40457 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.934391 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000015 Time: 1.1959 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000016 Time: 1.55573 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000017 Time: 2.3154 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000001c Time: 0.100098 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000001d Time: 0.100249 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000001e Time: 0.134848 [02/13/2023-19:54:44] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.100098 [02/13/2023-19:54:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:54:44] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:44] [V] [TRT] *************** Autotuning format combination: Float(552960,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:54:44] [V] [TRT] --------------- Timing Runner: Conv_135 (CudaDepthwiseConvolution) [02/13/2023-19:54:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:44] [V] [TRT] --------------- Timing Runner: Conv_135 (CudnnConvolution) [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.189874 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.187621 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.192539 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.188571 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.186359 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x000000000000003a Time: 0.180658 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.188731 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.191026 [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.18507 [02/13/2023-19:54:44] [V] [TRT] Fastest Tactic: 0x000000000000003a Time: 0.180658 [02/13/2023-19:54:44] [V] [TRT] --------------- Timing Runner: Conv_135 (CaskConvolution) [02/13/2023-19:54:44] [V] [TRT] Conv_135 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:54:44] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 13.6994 [02/13/2023-19:54:45] [V] [TRT] Conv_135 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:54:45] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 16.5463 [02/13/2023-19:54:45] [V] [TRT] Conv_135 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:54:45] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 12.986 [02/13/2023-19:54:45] [V] [TRT] Conv_135 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:54:45] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 14.3478 [02/13/2023-19:54:45] [V] [TRT] Conv_135 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r5s5_aligna4_alignc4 Tactic: 0x967f94e9db2001a8 [02/13/2023-19:54:45] [V] [TRT] Tactic: 0x967f94e9db2001a8 Time: 8.69358 [02/13/2023-19:54:45] [V] [TRT] Conv_135 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:54:45] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 8.81942 [02/13/2023-19:54:45] [V] [TRT] Conv_135 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:54:46] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 28.4572 [02/13/2023-19:54:46] [V] [TRT] Conv_135 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:54:46] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 10.2649 [02/13/2023-19:54:46] [V] [TRT] Conv_135 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:46] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 16.5059 [02/13/2023-19:54:46] [V] [TRT] Conv_135 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:46] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 14.7242 [02/13/2023-19:54:46] [V] [TRT] Fastest Tactic: 0x967f94e9db2001a8 Time: 8.69358 [02/13/2023-19:54:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003a [02/13/2023-19:54:46] [V] [TRT] *************** Autotuning format combination: Float(552960,1,30720,960) -> Float(552960,1,30720,960) *************** [02/13/2023-19:54:46] [V] [TRT] --------------- Timing Runner: Conv_135 (CaskConvolution) [02/13/2023-19:54:46] [V] [TRT] Conv_135 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:54:47] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 17.0134 [02/13/2023-19:54:47] [V] [TRT] Conv_135 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:54:47] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 24.7317 [02/13/2023-19:54:47] [V] [TRT] Conv_135 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r5s5_aligna4_alignc4 Tactic: 0x45ff0c3a09b02e78 [02/13/2023-19:54:47] [V] [TRT] Tactic: 0x45ff0c3a09b02e78 Time: 16.605 [02/13/2023-19:54:47] [V] [TRT] Conv_135 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:54:47] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 16.9352 [02/13/2023-19:54:47] [V] [TRT] Conv_135 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 42.4146 [02/13/2023-19:54:48] [V] [TRT] Conv_135 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d739 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0xca7eeb8d9143d739 Time: 10.1351 [02/13/2023-19:54:48] [V] [TRT] Conv_135 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf50 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0xd9031472c05adf50 Time: 10.0856 [02/13/2023-19:54:48] [V] [TRT] Fastest Tactic: 0xd9031472c05adf50 Time: 10.0856 [02/13/2023-19:54:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd9031472c05adf50 [02/13/2023-19:54:48] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,7680,240) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:54:48] [V] [TRT] --------------- Timing Runner: Conv_135 (CaskConvolution) [02/13/2023-19:54:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:48] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:48] [V] [TRT] *************** Autotuning format combination: Float(552960,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:54:48] [V] [TRT] *************** Autotuning format combination: Float(552960,1,30720,960) -> Float(552960,1,30720,960) *************** [02/13/2023-19:54:48] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,7680,240) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:54:48] [V] [TRT] *************** Autotuning format combination: Float(17280,576:32,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:54:48] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:48] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:48] [V] [TRT] *************** Autotuning format combination: Float(552960,576,32,1) -> Float(960,1,1,1) *************** [02/13/2023-19:54:48] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_138 (TiledPooling) [02/13/2023-19:54:48] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [02/13/2023-19:54:48] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_138 (CudnnPooling) [02/13/2023-19:54:48] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.0112018 [02/13/2023-19:54:48] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.0112018 [02/13/2023-19:54:48] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_138 (CaskPooling) [02/13/2023-19:54:48] [V] [TRT] GlobalAveragePool_138 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Average_FastDiv Tactic: 0x933eceba7b866d59 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x933eceba7b866d59 Time: 0.0111859 [02/13/2023-19:54:48] [V] [TRT] Fastest Tactic: 0x933eceba7b866d59 Time: 0.0111859 [02/13/2023-19:54:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x933eceba7b866d59 [02/13/2023-19:54:48] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,7680,240) -> Float(240,1:4,240,240) *************** [02/13/2023-19:54:48] [V] [TRT] --------------- Timing Runner: GlobalAveragePool_138 (CaskPooling) [02/13/2023-19:54:48] [V] [TRT] GlobalAveragePool_138 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Average_FastDiv_CAlign4 Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:54:48] [V] [TRT] Tactic: 0xfab3e2ee1c085a9a Time: 0.0138689 [02/13/2023-19:54:48] [V] [TRT] Fastest Tactic: 0xfab3e2ee1c085a9a Time: 0.0138689 [02/13/2023-19:54:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:54:48] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:48] [V] [TRT] *************** Autotuning format combination: Float(960,1,1,1) -> Float(240,1,1,1) *************** [02/13/2023-19:54:48] [V] [TRT] --------------- Timing Runner: Conv_139 + Relu_140 (CudaDepthwiseConvolution) [02/13/2023-19:54:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:48] [V] [TRT] --------------- Timing Runner: Conv_139 + Relu_140 (FusedConvActConvolution) [02/13/2023-19:54:48] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:48] [V] [TRT] --------------- Timing Runner: Conv_139 + Relu_140 (CudnnConvolution) [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0662339 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.01804 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.105726 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x0000000000000004 Time: 4.01298 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.647835 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0659444 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0184629 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x000000000000003a Time: 0.104101 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x000000000000003c Time: 4.0175 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x000000000000003d Time: 0.649445 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0665966 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.067107 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.104581 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x0000000000000074 Time: 3.99754 [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.648283 [02/13/2023-19:54:48] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.01804 [02/13/2023-19:54:48] [V] [TRT] --------------- Timing Runner: Conv_139 + Relu_140 (CublasConvolution) [02/13/2023-19:54:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0123966 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0122004 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0125657 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0123055 [02/13/2023-19:54:49] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0122004 [02/13/2023-19:54:49] [V] [TRT] --------------- Timing Runner: Conv_139 + Relu_140 (CaskConvolution) [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0349349 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0222968 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0390651 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0224078 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0609341 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0822971 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.184763 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0400823 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.121122 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0559208 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.15648 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0992526 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0675078 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0663345 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0495055 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0644937 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0330478 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.025277 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0696686 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0558187 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.09752 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0582796 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0965417 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.135915 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.091152 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.182661 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0544381 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.141127 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.15333 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xaa0953b1a73b0b9b Time: 0.00941171 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0930286 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.115801 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0826514 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0971909 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0265859 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.160197 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.127943 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.317984 [02/13/2023-19:54:49] [V] [TRT] Fastest Tactic: 0xaa0953b1a73b0b9b Time: 0.00941171 [02/13/2023-19:54:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:49] [V] [TRT] *************** Autotuning format combination: Float(960,1,960,960) -> Float(240,1,240,240) *************** [02/13/2023-19:54:49] [V] [TRT] --------------- Timing Runner: Conv_139 + Relu_140 (CublasConvolution) [02/13/2023-19:54:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:49] [V] [TRT] --------------- Timing Runner: Conv_139 + Relu_140 (CaskConvolution) [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0809006 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0412869 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.153733 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0405886 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0949006 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0248937 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0790423 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0529798 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0541806 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0939703 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.01808 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0244785 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0392171 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.154885 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0348206 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.049664 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0601219 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0580069 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0245577 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0253158 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.152718 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0158735 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0498819 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0412046 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0197691 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0603276 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.083296 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0244556 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0348133 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.137975 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.079232 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0519116 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0780137 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.158272 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.152064 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0589242 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0158747 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0264046 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.149778 [02/13/2023-19:54:49] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.0158735 [02/13/2023-19:54:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:54:49] [V] [TRT] *************** Autotuning format combination: Float(240,1:4,240,240) -> Float(60,1:4,60,60) *************** [02/13/2023-19:54:49] [V] [TRT] --------------- Timing Runner: Conv_139 + Relu_140 (CublasConvolution) [02/13/2023-19:54:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:49] [V] [TRT] --------------- Timing Runner: Conv_139 + Relu_140 (CaskConvolution) [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0412457 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0403166 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.024733 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.018164 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.024451 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0392103 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0349449 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0600579 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0580602 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0245615 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0254156 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0159533 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0413246 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0195909 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.059843 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0245257 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0349029 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0584366 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0159934 [02/13/2023-19:54:49] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0261829 [02/13/2023-19:54:49] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.0159533 [02/13/2023-19:54:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:54:49] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:49] [V] [TRT] *************** Autotuning format combination: Float(240,1,1,1) -> Float(960,1,1,1) *************** [02/13/2023-19:54:49] [V] [TRT] --------------- Timing Runner: Conv_141 (CudaDepthwiseConvolution) [02/13/2023-19:54:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:49] [V] [TRT] --------------- Timing Runner: Conv_141 (FusedConvActConvolution) [02/13/2023-19:54:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:49] [V] [TRT] --------------- Timing Runner: Conv_141 (CudnnConvolution) [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234057 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0128777 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0692114 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000004 Time: 3.98368 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.733829 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.0234651 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0128141 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0685577 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x000000000000003c Time: 3.98021 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x000000000000003d Time: 0.731767 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0235389 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0234658 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.0686613 [02/13/2023-19:54:49] [V] [TRT] Tactic: 0x0000000000000074 Time: 3.9818 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.734171 [02/13/2023-19:54:50] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.0128141 [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: Conv_141 (CublasConvolution) [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0122598 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0222263 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0116832 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0222537 [02/13/2023-19:54:50] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.0116832 [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: Conv_141 (CaskConvolution) [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0202211 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0199989 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0201674 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0205492 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0204389 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0350738 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.0582095 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0204944 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.0388091 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0284335 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.0474491 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0412823 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0306825 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0287168 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0225051 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0269082 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0179543 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0139828 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0325888 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0250705 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0394663 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0203857 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0322569 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.0413954 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0307273 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.056131 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0244594 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.0434343 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.0475086 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xaa0953b1a73b0b9b Time: 0.00693181 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0308727 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0372537 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.03628 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0330514 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0157705 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.0492267 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.0399851 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.0922903 [02/13/2023-19:54:50] [V] [TRT] Fastest Tactic: 0xaa0953b1a73b0b9b Time: 0.00693181 [02/13/2023-19:54:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:50] [V] [TRT] *************** Autotuning format combination: Float(240,1,240,240) -> Float(960,1,960,960) *************** [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: Conv_141 (CublasConvolution) [02/13/2023-19:54:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: Conv_141 (CaskConvolution) [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0266088 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0163855 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.0454297 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0178494 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0307328 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.011796 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0266309 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0333595 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0335305 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0307913 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00973897 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0117436 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0161214 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.0456617 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0160356 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0181937 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0243939 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0244411 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0128392 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0136528 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.0454731 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.013937 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0180943 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0161336 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0106181 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.024413 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0283101 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0118913 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0159477 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.0453737 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0266248 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0329701 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0266309 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.0473166 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.0454914 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0243977 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.014016 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0134699 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.0451509 [02/13/2023-19:54:50] [V] [TRT] Fastest Tactic: 0x46e3f4ab19d1017d Time: 0.00973897 [02/13/2023-19:54:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:50] [V] [TRT] *************** Autotuning format combination: Float(60,1:4,60,60) -> Float(240,1:4,240,240) *************** [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: Conv_141 (CublasConvolution) [02/13/2023-19:54:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: Conv_141 (CaskConvolution) [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0162743 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.017868 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0119184 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.00981425 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0118235 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0161194 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0159619 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0243619 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0241821 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.012696 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0136 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0137721 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0160869 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0103484 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0244549 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xba269390692faead Time: 0.011971 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0160284 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0244297 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0139553 [02/13/2023-19:54:50] [V] [TRT] Conv_141 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0135194 [02/13/2023-19:54:50] [V] [TRT] Fastest Tactic: 0x46e3f4ab19d1017d Time: 0.00981425 [02/13/2023-19:54:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:50] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:50] [V] [TRT] *************** Autotuning format combination: Float(960,1,1,1), Float(552960,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_142), Mul_143) (PointWiseV2) [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0431966 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0484571 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0464869 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0565059 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0580632 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0510491 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0717463 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0711314 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0707093 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.069667 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0446766 [02/13/2023-19:54:50] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0431966 [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_142), Mul_143) (PointWise) [02/13/2023-19:54:50] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [02/13/2023-19:54:50] [V] [TRT] *************** Autotuning format combination: Float(960,1,960,960), Float(552960,1,30720,960) -> Float(552960,1,30720,960) *************** [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_142), Mul_143) (PointWiseV2) [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0469451 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0351817 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.031381 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0316974 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0283253 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0278827 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0305189 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0288174 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0267863 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0268495 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0460103 [02/13/2023-19:54:50] [V] [TRT] Fastest Tactic: 0x0000000000000008 Time: 0.0267863 [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_142), Mul_143) (PointWise) [02/13/2023-19:54:50] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000008 [02/13/2023-19:54:50] [V] [TRT] *************** Autotuning format combination: Float(240,1:4,240,240), Float(138240,1:4,7680,240) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_142), Mul_143) (PointWiseV2) [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0374206 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.037288 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0506301 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0369474 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0476434 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0605547 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0380286 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0474229 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0500907 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.064547 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0343835 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0352119 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0373989 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0356837 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0376571 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0517989 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0359943 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0381474 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.047352 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0587185 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.050912 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.037208 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.032469 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0313691 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0374869 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0349339 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0500709 [02/13/2023-19:54:50] [V] [TRT] Fastest Tactic: 0x0000000000000017 Time: 0.0313691 [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_142), Mul_143) (PointWise) [02/13/2023-19:54:50] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000017 [02/13/2023-19:54:50] [V] [TRT] *************** Autotuning format combination: Float(30,1:32,1,1), Float(17280,576:32,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_142), Mul_143) (PointWiseV2) [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0374434 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0371154 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000001a Time: 0.037376 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0377943 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0369451 [02/13/2023-19:54:50] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0369451 [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_142), Mul_143) (PointWise) [02/13/2023-19:54:50] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [02/13/2023-19:54:50] [V] [TRT] *************** Autotuning format combination: Float(1:4,1,1,1), Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:50] [V] [TRT] --------------- Timing Runner: PWN(PWN(HardSigmoid_142), Mul_143) (PointWiseV2) [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.75747 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000001 Time: 2.164 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000002 Time: 2.10901 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000003 Time: 2.84174 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000004 Time: 2.82358 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000005 Time: 2.09013 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000006 Time: 4.19744 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000007 Time: 3.55343 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000008 Time: 3.80347 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x0000000000000009 Time: 2.93438 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000000a Time: 1.60856 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000000b Time: 2.03109 [02/13/2023-19:54:50] [V] [TRT] Tactic: 0x000000000000000c Time: 1.74688 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x000000000000000d Time: 2.53797 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x000000000000000e Time: 2.41388 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x000000000000000f Time: 1.7744 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000010 Time: 3.56926 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000011 Time: 2.93549 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000012 Time: 3.04558 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000013 Time: 2.01035 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000014 Time: 1.41447 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000015 Time: 1.81725 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000016 Time: 2.21723 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000017 Time: 3.03123 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x000000000000001c Time: 0.164914 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x000000000000001d Time: 0.128569 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x000000000000001e Time: 0.187301 [02/13/2023-19:54:51] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.128569 [02/13/2023-19:54:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [02/13/2023-19:54:51] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:51] [V] [TRT] *************** Autotuning format combination: Float(552960,576,32,1), Float(92160,576,32,1) -> Float(92160,576,32,1) *************** [02/13/2023-19:54:51] [V] [TRT] --------------- Timing Runner: Conv_144 + Add_145 (CudaDepthwiseConvolution) [02/13/2023-19:54:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:51] [V] [TRT] --------------- Timing Runner: Conv_144 + Add_145 (FusedConvActConvolution) [02/13/2023-19:54:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:51] [V] [TRT] --------------- Timing Runner: Conv_144 + Add_145 (CudnnConvolution) [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.137358 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.169975 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.329541 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000004 Time: 8.53239 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.01267 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.14147 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.169783 [02/13/2023-19:54:51] [V] [TRT] Tactic: 0x000000000000003a Time: 0.330249 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x000000000000003c Time: 8.53435 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x000000000000003d Time: 1.01427 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.136887 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.129872 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.329536 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x0000000000000074 Time: 8.55729 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x0000000000000075 Time: 1.00778 [02/13/2023-19:54:52] [V] [TRT] Fastest Tactic: 0x0000000000000071 Time: 0.129872 [02/13/2023-19:54:52] [V] [TRT] --------------- Timing Runner: Conv_144 + Add_145 (CublasConvolution) [02/13/2023-19:54:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:52] [V] [TRT] --------------- Timing Runner: Conv_144 + Add_145 (CaskConvolution) [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0751954 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0618728 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0436171 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0645272 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.106542 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.100114 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.20597 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0468366 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.13592 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.062525 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.160768 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.115511 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0958171 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0729417 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0568381 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0707916 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0716983 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0538209 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0839246 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.109312 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.109045 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.104523 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.103495 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.188654 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.171506 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.232046 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:52] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0697905 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.238519 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.15771 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:52] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.175182 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.128951 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.116738 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.10173 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0569021 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:52] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.160603 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.129392 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.351776 [02/13/2023-19:54:52] [V] [TRT] Fastest Tactic: 0x1016909b1fd6ff2f Time: 0.0436171 [02/13/2023-19:54:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:52] [V] [TRT] *************** Autotuning format combination: Float(552960,1,30720,960), Float(92160,1,5120,160) -> Float(92160,1,5120,160) *************** [02/13/2023-19:54:52] [V] [TRT] --------------- Timing Runner: Conv_144 + Add_145 (CublasConvolution) [02/13/2023-19:54:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:52] [V] [TRT] --------------- Timing Runner: Conv_144 + Add_145 (CaskConvolution) [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.157202 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0528351 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.166098 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0421554 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.102672 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.031883 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0901623 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0978651 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0989074 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.102494 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0381737 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0296896 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.042136 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.169029 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0386343 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0929486 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0678049 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0640488 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0498834 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0277356 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.154779 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0443303 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0902331 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:52] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0500983 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:52] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0378514 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:52] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0643307 [02/13/2023-19:54:52] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.084864 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0491825 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0372343 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.157426 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.152553 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0961737 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0833234 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.160704 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.16096 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0624198 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0441451 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0299739 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.162254 [02/13/2023-19:54:53] [V] [TRT] Fastest Tactic: 0x61f62003626e5959 Time: 0.0277356 [02/13/2023-19:54:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x61f62003626e5959 [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,7680,240), Float(23040,1:4,1280,40) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:54:53] [V] [TRT] --------------- Timing Runner: Conv_144 + Add_145 (CublasConvolution) [02/13/2023-19:54:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:53] [V] [TRT] --------------- Timing Runner: Conv_144 + Add_145 (CaskConvolution) [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0523977 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0413783 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0288923 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0344987 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.026477 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0412549 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0371189 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0665752 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0636145 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0494857 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0316535 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.04372 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0513554 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0396194 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0642316 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0495253 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0380446 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0625661 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0418149 [02/13/2023-19:54:53] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0266956 [02/13/2023-19:54:53] [V] [TRT] Fastest Tactic: 0x4aa9c14ea2943ef0 Time: 0.026477 [02/13/2023-19:54:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:53] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(92160,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(92160,1,5120,160) -> Float(552960,1,30720,960) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(23040,1:4,1280,40) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:54:53] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(552960,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(552960,1,30720,960) -> Float(552960,1,30720,960) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,7680,240) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(17280,576:32,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(552960,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(552960,1,30720,960) -> Float(552960,1,30720,960) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,7680,240) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:54:53] [V] [TRT] --------------- Timing Runner: Conv_149 (CaskConvolution) [02/13/2023-19:54:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:53] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(552960,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(552960,1,30720,960) -> Float(552960,1,30720,960) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,7680,240) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(17280,576:32,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(552960,576,32,1) -> Float(960,1,1,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,7680,240) -> Float(240,1:4,240,240) *************** [02/13/2023-19:54:53] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(960,1,1,1) -> Float(240,1,1,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(960,1,960,960) -> Float(240,1,240,240) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(240,1:4,240,240) -> Float(60,1:4,60,60) *************** [02/13/2023-19:54:53] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(240,1,1,1) -> Float(960,1,1,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(240,1,240,240) -> Float(960,1,960,960) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(60,1:4,60,60) -> Float(240,1:4,240,240) *************** [02/13/2023-19:54:53] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(960,1,1,1), Float(552960,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(960,1,960,960), Float(552960,1,30720,960) -> Float(552960,1,30720,960) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(240,1:4,240,240), Float(138240,1:4,7680,240) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(30,1:32,1,1), Float(17280,576:32,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(1:4,1,1,1), Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(552960,576,32,1), Float(92160,576,32,1) -> Float(92160,576,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(552960,1,30720,960), Float(92160,1,5120,160) -> Float(92160,1,5120,160) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,7680,240), Float(23040,1:4,1280,40) -> Float(23040,1:4,1280,40) *************** [02/13/2023-19:54:53] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(92160,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(92160,1,5120,160) -> Float(552960,1,30720,960) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(23040,1:4,1280,40) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:54:53] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(552960,576,32,1) -> Float(552960,576,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(552960,1,30720,960) -> Float(552960,1,30720,960) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,7680,240) -> Float(138240,1:4,7680,240) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(17280,576:32,32,1) -> Float(17280,576:32,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:53] [V] [TRT] *************** Autotuning format combination: Float(552960,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:54:53] [V] [TRT] --------------- Timing Runner: Conv_163 + Relu_164 (CudaDepthwiseConvolution) [02/13/2023-19:54:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:53] [V] [TRT] --------------- Timing Runner: Conv_163 + Relu_164 (FusedConvActConvolution) [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.282144 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.174679 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.139079 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000000cffff Time: 0.115458 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000011ffff Time: 0.0948229 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.120912 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000001fffff Time: 0.127479 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.089568 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.165531 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000003cffff Time: 0.127077 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.135557 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000040ffff Time: 0.106128 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000045ffff Time: 0.107481 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000046ffff Time: 0.09456 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000004affff Time: 0.129568 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.186295 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000004effff Time: 0.10437 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.100933 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000051ffff Time: 0.123685 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.121305 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.342309 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000059ffff Time: 0.103616 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000005effff Time: 0.102537 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000005fffff Time: 0.0935954 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.119819 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000006affff Time: 0.128761 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.0897166 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.235557 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.113634 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000006fffff Time: 0.102254 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.155461 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.0952686 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.160581 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.114121 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000008affff Time: 0.125362 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000091ffff Time: 0.126933 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x00000000009dffff Time: 0.133545 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.0972594 [02/13/2023-19:54:53] [V] [TRT] Fastest Tactic: 0x000000000035ffff Time: 0.089568 [02/13/2023-19:54:53] [V] [TRT] --------------- Timing Runner: Conv_163 + Relu_164 (CudnnConvolution) [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.122841 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.054915 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.322281 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x0000000000000004 Time: 6.84629 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.855346 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.124039 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0564754 [02/13/2023-19:54:53] [V] [TRT] Tactic: 0x000000000000003a Time: 0.322789 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x000000000000003c Time: 6.88087 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x000000000000003d Time: 0.854656 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.123305 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.122864 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.324553 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x0000000000000074 Time: 6.86304 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.856283 [02/13/2023-19:54:54] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.054915 [02/13/2023-19:54:54] [V] [TRT] --------------- Timing Runner: Conv_163 + Relu_164 (CublasConvolution) [02/13/2023-19:54:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:54] [V] [TRT] --------------- Timing Runner: Conv_163 + Relu_164 (CaskConvolution) [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0371257 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.062403 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0434709 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.0623253 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.104432 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0914446 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.182441 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.0434206 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.121513 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0581577 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.157591 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.103648 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0726354 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0707063 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0514011 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0710461 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0347648 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0496518 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0764114 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.0619048 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.101495 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.105115 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0971863 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.146898 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0914811 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.181207 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0602514 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.152617 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.155954 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0977097 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.11605 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0914583 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.098144 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0530179 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.159278 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.12669 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.320137 [02/13/2023-19:54:54] [V] [TRT] Fastest Tactic: 0x5f5015dbf902f0a3 Time: 0.0347648 [02/13/2023-19:54:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:54] [V] [TRT] *************** Autotuning format combination: Float(552960,1,30720,960) -> Float(73728,1,4096,128) *************** [02/13/2023-19:54:54] [V] [TRT] --------------- Timing Runner: Conv_163 + Relu_164 (CublasConvolution) [02/13/2023-19:54:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:54] [V] [TRT] --------------- Timing Runner: Conv_163 + Relu_164 (CaskConvolution) [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.090352 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0497067 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.161147 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0411726 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.09776 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0260427 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0813851 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0965943 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0997714 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0982377 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0329225 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0245905 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0418343 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.162414 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0353006 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0893646 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0623101 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0614354 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0257105 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0262895 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.153902 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0426743 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0912617 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0496457 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0350363 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.062464 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.08344 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0246347 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0350226 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.152087 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0814103 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0947863 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.0812411 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.163744 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.157189 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0604297 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0427234 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0266583 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.157687 [02/13/2023-19:54:54] [V] [TRT] Fastest Tactic: 0x4aa9c14ea2943ef0 Time: 0.0245905 [02/13/2023-19:54:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:54] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,7680,240) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:54:54] [V] [TRT] --------------- Timing Runner: Conv_163 + Relu_164 (CublasConvolution) [02/13/2023-19:54:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:54] [V] [TRT] --------------- Timing Runner: Conv_163 + Relu_164 (CaskConvolution) [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0498438 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0430697 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0254537 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0327269 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0245158 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0412994 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0351936 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0619688 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0603291 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.024973 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0261867 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0389234 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.049693 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0348617 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.062592 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0275192 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0350967 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.060131 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0428594 [02/13/2023-19:54:54] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0264373 [02/13/2023-19:54:54] [V] [TRT] Fastest Tactic: 0x4aa9c14ea2943ef0 Time: 0.0245158 [02/13/2023-19:54:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:54] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:54] [V] [TRT] *************** Autotuning format combination: Float(552960,576,32,1) -> Float(960,1,1,1) *************** [02/13/2023-19:54:54] [V] [TRT] *************** Autotuning format combination: Float(138240,1:4,7680,240) -> Float(240,1:4,240,240) *************** [02/13/2023-19:54:54] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:54] [V] [TRT] *************** Autotuning format combination: Float(960,1,1,1) -> Float(128,1,1,1) *************** [02/13/2023-19:54:54] [V] [TRT] --------------- Timing Runner: Conv_166 (CudaDepthwiseConvolution) [02/13/2023-19:54:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:54] [V] [TRT] --------------- Timing Runner: Conv_166 (FusedConvActConvolution) [02/13/2023-19:54:54] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:54] [V] [TRT] --------------- Timing Runner: Conv_166 (CudnnConvolution) [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0556602 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00748 [02/13/2023-19:54:54] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.094704 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000004 Time: 2.15279 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.500082 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.055971 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.00746971 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x000000000000003a Time: 0.0950674 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x000000000000003c Time: 2.14658 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x000000000000003d Time: 0.500544 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.0557486 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.0568061 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.094656 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000074 Time: 2.14603 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.500174 [02/13/2023-19:54:55] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.00746971 [02/13/2023-19:54:55] [V] [TRT] --------------- Timing Runner: Conv_166 (CublasConvolution) [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00783471 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0116582 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00746514 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0116733 [02/13/2023-19:54:55] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.00746514 [02/13/2023-19:54:55] [V] [TRT] --------------- Timing Runner: Conv_166 (CaskConvolution) [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 0.0349787 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.0224039 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.0388914 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.022432 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.0605349 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x20109de926a12263 Time: 0.0834011 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 0.180882 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.040016 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.121241 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 0.0556343 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.156224 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.0981303 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.0667048 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.0661791 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.0497509 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.0642545 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 0.0328064 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.0253371 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 0.0686354 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.055587 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.0965714 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.0581379 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.0962149 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.135765 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.0900709 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 0.179269 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.0538987 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.141333 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.152827 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xaa0953b1a73b0b9b Time: 0.00902029 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.0926514 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.115826 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 0.0835794 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.0971977 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.0264747 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.159118 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.128601 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.317632 [02/13/2023-19:54:55] [V] [TRT] Fastest Tactic: 0xaa0953b1a73b0b9b Time: 0.00902029 [02/13/2023-19:54:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CublasConvolution Tactic: 0x0000000000000002 [02/13/2023-19:54:55] [V] [TRT] *************** Autotuning format combination: Float(960,1,960,960) -> Float(128,1,128,128) *************** [02/13/2023-19:54:55] [V] [TRT] --------------- Timing Runner: Conv_166 (CublasConvolution) [02/13/2023-19:54:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:55] [V] [TRT] --------------- Timing Runner: Conv_166 (CaskConvolution) [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.0799566 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0412994 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.152951 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0400149 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.0934057 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.0246194 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.0793326 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.0518918 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.0534796 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.0936434 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0180577 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0245135 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0392503 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.153403 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0348955 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.0497204 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0593585 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0582583 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0243467 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0246377 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.151342 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0159324 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.0499002 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.041072 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0189057 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0586743 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.0826583 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0244503 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0340827 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.137689 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.0792846 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.0512792 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.077408 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.156453 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.151333 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0589912 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0158176 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.0262933 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.148137 [02/13/2023-19:54:55] [V] [TRT] Fastest Tactic: 0xed09dcddfcf4bffb Time: 0.0158176 [02/13/2023-19:54:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:55] [V] [TRT] *************** Autotuning format combination: Float(240,1:4,240,240) -> Float(32,1:4,32,32) *************** [02/13/2023-19:54:55] [V] [TRT] --------------- Timing Runner: Conv_166 (CublasConvolution) [02/13/2023-19:54:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:54:55] [V] [TRT] --------------- Timing Runner: Conv_166 (CaskConvolution) [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.0412194 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.0394926 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.024691 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.0182931 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.0244709 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.0391703 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.0349129 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.0591985 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.0583787 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.0245051 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.0245509 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.0158405 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.0408731 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.0188606 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.0590751 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xba269390692faead Time: 0.0245181 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.0340919 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.0586392 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.0159065 [02/13/2023-19:54:55] [V] [TRT] Conv_166 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:54:55] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.026227 [02/13/2023-19:54:55] [V] [TRT] Fastest Tactic: 0x85222248e9a8aead Time: 0.0158405 [02/13/2023-19:54:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85222248e9a8aead [02/13/2023-19:54:55] [V] [TRT] =============== Computing costs for [02/13/2023-19:54:55] [V] [TRT] *************** Autotuning format combination: Float(128,1,1,1), Float(73728,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:54:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_167), Mul_168) (PointWiseV2) [02/13/2023-19:54:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.009088 [02/13/2023-19:54:56] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0095296 [02/13/2023-19:54:56] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.009536 [02/13/2023-19:54:56] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0117538 [02/13/2023-19:54:57] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0116726 [02/13/2023-19:54:57] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00972221 [02/13/2023-19:54:57] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0137455 [02/13/2023-19:54:58] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0138651 [02/13/2023-19:54:58] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.01361 [02/13/2023-19:54:58] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0125989 [02/13/2023-19:54:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.009032 [02/13/2023-19:54:58] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.009032 [02/13/2023-19:54:58] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_167), Mul_168) (PointWise) [02/13/2023-19:54:58] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:54:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:54:58] [V] [TRT] *************** Autotuning format combination: Float(128,1,128,128), Float(73728,1,4096,128) -> Float(73728,1,4096,128) *************** [02/13/2023-19:54:58] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_167), Mul_168) (PointWiseV2) [02/13/2023-19:54:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00952472 [02/13/2023-19:54:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00756716 [02/13/2023-19:54:59] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00742331 [02/13/2023-19:55:00] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00678442 [02/13/2023-19:55:00] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00698035 [02/13/2023-19:55:00] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0065066 [02/13/2023-19:55:01] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00725097 [02/13/2023-19:55:01] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00732457 [02/13/2023-19:55:01] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00725806 [02/13/2023-19:55:02] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0071472 [02/13/2023-19:55:02] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0095424 [02/13/2023-19:55:02] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.0065066 [02/13/2023-19:55:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_167), Mul_168) (PointWise) [02/13/2023-19:55:02] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:55:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:55:02] [V] [TRT] *************** Autotuning format combination: Float(32,1:4,32,32), Float(18432,1:4,1024,32) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:55:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_167), Mul_168) (PointWiseV2) [02/13/2023-19:55:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00753155 [02/13/2023-19:55:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00757991 [02/13/2023-19:55:03] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00759988 [02/13/2023-19:55:03] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00777311 [02/13/2023-19:55:03] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00815594 [02/13/2023-19:55:04] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00784602 [02/13/2023-19:55:04] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00890299 [02/13/2023-19:55:04] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00944057 [02/13/2023-19:55:05] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00929171 [02/13/2023-19:55:05] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00936857 [02/13/2023-19:55:05] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0080287 [02/13/2023-19:55:06] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00802718 [02/13/2023-19:55:06] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00820063 [02/13/2023-19:55:06] [V] [TRT] Tactic: 0x000000000000000d Time: 0.009188 [02/13/2023-19:55:07] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00852276 [02/13/2023-19:55:07] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00816305 [02/13/2023-19:55:07] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00960305 [02/13/2023-19:55:08] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0100002 [02/13/2023-19:55:08] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00983497 [02/13/2023-19:55:08] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00936114 [02/13/2023-19:55:09] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.012219 [02/13/2023-19:55:09] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00980693 [02/13/2023-19:55:09] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00789029 [02/13/2023-19:55:10] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00980876 [02/13/2023-19:55:10] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00840901 [02/13/2023-19:55:10] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00914029 [02/13/2023-19:55:10] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0131599 [02/13/2023-19:55:10] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00753155 [02/13/2023-19:55:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_167), Mul_168) (PointWise) [02/13/2023-19:55:10] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:55:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [02/13/2023-19:55:10] [V] [TRT] *************** Autotuning format combination: Float(4,1:32,1,1), Float(2304,576:32,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:55:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_167), Mul_168) (PointWiseV2) [02/13/2023-19:55:11] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0103873 [02/13/2023-19:55:11] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.010208 [02/13/2023-19:55:11] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0159101 [02/13/2023-19:55:12] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0200771 [02/13/2023-19:55:12] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0177041 [02/13/2023-19:55:12] [V] [TRT] Fastest Tactic: 0x0000000000000019 Time: 0.010208 [02/13/2023-19:55:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_167), Mul_168) (PointWise) [02/13/2023-19:55:12] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:55:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000019 [02/13/2023-19:55:12] [V] [TRT] *************** Autotuning format combination: Float(1:4,1,1,1), Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:55:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Sigmoid_167), Mul_168) (PointWiseV2) [02/13/2023-19:55:12] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.629792 [02/13/2023-19:55:13] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.865559 [02/13/2023-19:55:13] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.739557 [02/13/2023-19:55:13] [V] [TRT] Tactic: 0x0000000000000003 Time: 1.24023 [02/13/2023-19:55:14] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.928718 [02/13/2023-19:55:14] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.898935 [02/13/2023-19:55:14] [V] [TRT] Tactic: 0x0000000000000006 Time: 3.31166 [02/13/2023-19:55:15] [V] [TRT] Tactic: 0x0000000000000007 Time: 1.87086 [02/13/2023-19:55:15] [V] [TRT] Tactic: 0x0000000000000008 Time: 1.76814 [02/13/2023-19:55:16] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.49684 [02/13/2023-19:55:16] [V] [TRT] Tactic: 0x000000000000000a Time: 0.930642 [02/13/2023-19:55:16] [V] [TRT] Tactic: 0x000000000000000b Time: 1.19904 [02/13/2023-19:55:17] [V] [TRT] Tactic: 0x000000000000000c Time: 1.00401 [02/13/2023-19:55:17] [V] [TRT] Tactic: 0x000000000000000d Time: 1.58508 [02/13/2023-19:55:17] [V] [TRT] Tactic: 0x000000000000000e Time: 1.3009 [02/13/2023-19:55:18] [V] [TRT] Tactic: 0x000000000000000f Time: 1.00699 [02/13/2023-19:55:18] [V] [TRT] Tactic: 0x0000000000000010 Time: 2.35845 [02/13/2023-19:55:18] [V] [TRT] Tactic: 0x0000000000000011 Time: 1.57427 [02/13/2023-19:55:19] [V] [TRT] Tactic: 0x0000000000000012 Time: 1.43677 [02/13/2023-19:55:19] [V] [TRT] Tactic: 0x0000000000000013 Time: 1.13788 [02/13/2023-19:55:19] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.812261 [02/13/2023-19:55:20] [V] [TRT] Tactic: 0x0000000000000015 Time: 1.04509 [02/13/2023-19:55:20] [V] [TRT] Tactic: 0x0000000000000016 Time: 1.30571 [02/13/2023-19:55:20] [V] [TRT] Tactic: 0x0000000000000017 Time: 1.83817 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0708571 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0700602 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x000000000000001e Time: 0.114219 [02/13/2023-19:55:21] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.0700602 [02/13/2023-19:55:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [02/13/2023-19:55:21] [V] [TRT] =============== Computing costs for [02/13/2023-19:55:21] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:55:21] [V] [TRT] --------------- Timing Runner: Expand_174 (Slice) [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0179322 [02/13/2023-19:55:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0179322 [02/13/2023-19:55:21] [V] [TRT] --------------- Timing Runner: Expand_174 (Padding) [02/13/2023-19:55:21] [V] [TRT] Padding has no valid tactics for this config, skipping [02/13/2023-19:55:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [02/13/2023-19:55:21] [V] [TRT] =============== Computing costs for [02/13/2023-19:55:21] [V] [TRT] *************** Autotuning format combination: Float(73728,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:55:21] [V] [TRT] --------------- Timing Runner: Conv_176 (CudaDepthwiseConvolution) [02/13/2023-19:55:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:55:21] [V] [TRT] --------------- Timing Runner: Conv_176 (FusedConvActConvolution) [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x000000000007ffff Time: 0.465467 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x00000000000affff Time: 0.432489 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x00000000000effff Time: 0.367534 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x00000000000fffff Time: 0.45131 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x00000000001effff Time: 0.487895 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x000000000027ffff Time: 0.424814 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x000000000034ffff Time: 0.574834 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x000000000038ffff Time: 0.363013 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x000000000062ffff Time: 0.372398 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x00000000006effff Time: 0.315753 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x000000000086ffff Time: 0.428718 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x000000000089ffff Time: 0.346359 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x00000000009fffff Time: 0.319858 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x0000000000a2ffff Time: 0.308443 [02/13/2023-19:55:21] [V] [TRT] Fastest Tactic: 0x0000000000a2ffff Time: 0.308443 [02/13/2023-19:55:21] [V] [TRT] --------------- Timing Runner: Conv_176 (CudnnConvolution) [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.58683 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.253874 [02/13/2023-19:55:21] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.65829 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x0000000000000004 Time: 14.401 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.91561 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.126286 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.229705 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0990789 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x000000000000003a Time: 0.279003 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x000000000000003c Time: 10.5079 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x000000000000003d Time: 1.65947 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x000000000000003e Time: 0.091328 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.165522 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.164809 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.204983 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x0000000000000074 Time: 7.77564 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x0000000000000075 Time: 1.30421 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.0785029 [02/13/2023-19:55:22] [V] [TRT] Fastest Tactic: 0x0000000000000076 Time: 0.0785029 [02/13/2023-19:55:22] [V] [TRT] --------------- Timing Runner: Conv_176 (CaskConvolution) [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 0.110878 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 0.116158 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.144014 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x4727434768e46395 Time: 0.123593 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 0.379333 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.186546 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 0.197527 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 0.110706 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 0.153495 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 0.0600579 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 0.123026 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.176219 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 0.380667 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 0.195671 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.194281 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.163465 [02/13/2023-19:55:22] [V] [TRT] Fastest Tactic: 0x94119b4c514b211a Time: 0.0600579 [02/13/2023-19:55:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94119b4c514b211a [02/13/2023-19:55:22] [V] [TRT] *************** Autotuning format combination: Float(73728,1,4096,128) -> Float(73728,1,4096,128) *************** [02/13/2023-19:55:22] [V] [TRT] --------------- Timing Runner: Conv_176 (CaskConvolution) [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.0328247 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.0349184 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.119458 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.100128 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.072544 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.0413394 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.112114 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.0371074 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.0883794 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.0409829 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.114286 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.114587 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 0.171959 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.114347 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.0730446 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.190574 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.0708449 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.106094 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x634e99502974e4da Time: 0.186651 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.060445 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.0291319 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.0308992 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.0434743 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.045264 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.031541 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.183168 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.171991 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.0391806 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.106491 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.0731131 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.0560472 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.0464206 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.057757 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.0322139 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.0537432 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 0.108935 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.0307666 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.191173 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.0497585 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.0984206 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.0285751 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.0489356 [02/13/2023-19:55:22] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:55:22] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.190085 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.0413051 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.0762103 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.0305125 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.0621973 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.100146 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.179063 [02/13/2023-19:55:23] [V] [TRT] Fastest Tactic: 0xd4428a7355769d7d Time: 0.0285751 [02/13/2023-19:55:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd4428a7355769d7d [02/13/2023-19:55:23] [V] [TRT] *************** Autotuning format combination: Float(18432,1:4,1024,32) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:55:23] [V] [TRT] --------------- Timing Runner: Conv_176 (CaskConvolution) [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.0327909 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.0349513 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.0722583 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.0413897 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.0372263 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.0884251 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.0395086 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.0730423 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.0706575 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.0614248 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.0293577 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.0311808 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.0433646 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.0454857 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.0313554 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.0393463 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.0730811 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.0562118 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.0470503 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.0581836 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.0321783 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.0538301 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.0312027 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.0498773 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.0287936 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.0494461 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.0412274 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.0768297 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.0308078 [02/13/2023-19:55:23] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.0624198 [02/13/2023-19:55:23] [V] [TRT] Fastest Tactic: 0xd4428a7355769d7d Time: 0.0287936 [02/13/2023-19:55:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd4428a7355769d7d [02/13/2023-19:55:23] [V] [TRT] =============== Computing costs for [02/13/2023-19:55:23] [V] [TRT] *************** Autotuning format combination: Float(73728,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:55:23] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_177) (PointWiseV2) [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00675532 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00558488 [02/13/2023-19:55:23] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00543746 [02/13/2023-19:55:24] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00544051 [02/13/2023-19:55:24] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00548097 [02/13/2023-19:55:24] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0052351 [02/13/2023-19:55:25] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00636999 [02/13/2023-19:55:25] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00543509 [02/13/2023-19:55:25] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00537295 [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00529338 [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0067626 [02/13/2023-19:55:26] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.0052351 [02/13/2023-19:55:26] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_177) (PointWise) [02/13/2023-19:55:26] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:55:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:55:26] [V] [TRT] *************** Autotuning format combination: Float(73728,1,4096,128) -> Float(73728,1,4096,128) *************** [02/13/2023-19:55:26] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_177) (PointWiseV2) [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00687826 [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00552369 [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0055084 [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00545338 [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0054339 [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00525437 [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00650784 [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00542459 [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00537397 [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00537651 [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00681556 [02/13/2023-19:55:26] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00525437 [02/13/2023-19:55:26] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_177) (PointWise) [02/13/2023-19:55:26] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:55:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:55:26] [V] [TRT] *************** Autotuning format combination: Float(18432,1:4,1024,32) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:55:26] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_177) (PointWiseV2) [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00617676 [02/13/2023-19:55:26] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00635627 [02/13/2023-19:55:27] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0064477 [02/13/2023-19:55:27] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00664 [02/13/2023-19:55:27] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00659283 [02/13/2023-19:55:28] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00704348 [02/13/2023-19:55:28] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00740023 [02/13/2023-19:55:28] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00741646 [02/13/2023-19:55:29] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00750606 [02/13/2023-19:55:29] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00796495 [02/13/2023-19:55:29] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0195029 [02/13/2023-19:55:30] [V] [TRT] Tactic: 0x000000000000000b Time: 0.019692 [02/13/2023-19:55:30] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0227847 [02/13/2023-19:55:30] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0233861 [02/13/2023-19:55:30] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0228663 [02/13/2023-19:55:31] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0229786 [02/13/2023-19:55:31] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0261303 [02/13/2023-19:55:31] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0230374 [02/13/2023-19:55:32] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0230256 [02/13/2023-19:55:32] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0229584 [02/13/2023-19:55:32] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0233718 [02/13/2023-19:55:33] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0229068 [02/13/2023-19:55:33] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0225384 [02/13/2023-19:55:33] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0228343 [02/13/2023-19:55:34] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0229029 [02/13/2023-19:55:34] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0228082 [02/13/2023-19:55:34] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0229995 [02/13/2023-19:55:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00617676 [02/13/2023-19:55:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_177) (PointWise) [02/13/2023-19:55:34] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:55:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [02/13/2023-19:55:34] [V] [TRT] *************** Autotuning format combination: Float(2304,576:32,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:55:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_177) (PointWiseV2) [02/13/2023-19:55:34] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0227703 [02/13/2023-19:55:35] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0229623 [02/13/2023-19:55:35] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0229336 [02/13/2023-19:55:35] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0277394 [02/13/2023-19:55:36] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0229061 [02/13/2023-19:55:36] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.0227703 [02/13/2023-19:55:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_177) (PointWise) [02/13/2023-19:55:36] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:55:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [02/13/2023-19:55:36] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:55:36] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_177) (PointWiseV2) [02/13/2023-19:55:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.606761 [02/13/2023-19:55:36] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.740873 [02/13/2023-19:55:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.821614 [02/13/2023-19:55:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.872878 [02/13/2023-19:55:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.1137 [02/13/2023-19:55:38] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.823963 [02/13/2023-19:55:38] [V] [TRT] Tactic: 0x0000000000000006 Time: 1.13018 [02/13/2023-19:55:38] [V] [TRT] Tactic: 0x0000000000000007 Time: 1.47159 [02/13/2023-19:55:39] [V] [TRT] Tactic: 0x0000000000000008 Time: 1.26799 [02/13/2023-19:55:39] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.03035 [02/13/2023-19:55:39] [V] [TRT] Tactic: 0x000000000000000a Time: 0.576334 [02/13/2023-19:55:40] [V] [TRT] Tactic: 0x000000000000000b Time: 0.813024 [02/13/2023-19:55:40] [V] [TRT] Tactic: 0x000000000000000c Time: 0.680494 [02/13/2023-19:55:40] [V] [TRT] Tactic: 0x000000000000000d Time: 1.13118 [02/13/2023-19:55:41] [V] [TRT] Tactic: 0x000000000000000e Time: 0.918747 [02/13/2023-19:55:41] [V] [TRT] Tactic: 0x000000000000000f Time: 0.702491 [02/13/2023-19:55:41] [V] [TRT] Tactic: 0x0000000000000010 Time: 1.77183 [02/13/2023-19:55:42] [V] [TRT] Tactic: 0x0000000000000011 Time: 1.22308 [02/13/2023-19:55:42] [V] [TRT] Tactic: 0x0000000000000012 Time: 1.03907 [02/13/2023-19:55:42] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.838299 [02/13/2023-19:55:43] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.505143 [02/13/2023-19:55:43] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.70453 [02/13/2023-19:55:43] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.978597 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x0000000000000017 Time: 1.52764 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0515962 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0523032 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0729874 [02/13/2023-19:55:44] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0515962 [02/13/2023-19:55:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:55:44] [V] [TRT] =============== Computing costs for [02/13/2023-19:55:44] [V] [TRT] *************** Autotuning format combination: Float(73728,576,32,1), Float(73728,576,32,1) -> Float(73728,576,32,1) *************** [02/13/2023-19:55:44] [V] [TRT] --------------- Timing Runner: Mul_179 (ElementWise) [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0183194 [02/13/2023-19:55:44] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0183194 [02/13/2023-19:55:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:55:44] [V] [TRT] *************** Autotuning format combination: Float(18432,1:4,1024,32), Float(18432,1:4,1024,32) -> Float(18432,1:4,1024,32) *************** [02/13/2023-19:55:44] [V] [TRT] --------------- Timing Runner: Mul_179 (ElementWise) [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0228728 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0283596 [02/13/2023-19:55:44] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0228728 [02/13/2023-19:55:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:55:44] [V] [TRT] *************** Autotuning format combination: Float(2304,576:32,32,1), Float(2304,576:32,32,1) -> Float(2304,576:32,32,1) *************** [02/13/2023-19:55:44] [V] [TRT] --------------- Timing Runner: Mul_179 (ElementWise) [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0182983 [02/13/2023-19:55:44] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0182983 [02/13/2023-19:55:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:55:44] [V] [TRT] =============== Computing costs for [02/13/2023-19:55:44] [V] [TRT] *************** Autotuning format combination: Float(73728,576,32,1) -> Float(36864,576,32,1) *************** [02/13/2023-19:55:44] [V] [TRT] --------------- Timing Runner: Conv_181 (CudaDepthwiseConvolution) [02/13/2023-19:55:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:55:44] [V] [TRT] --------------- Timing Runner: Conv_181 (FusedConvActConvolution) [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x000000000007ffff Time: 0.326505 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x00000000000affff Time: 0.282057 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x00000000000effff Time: 0.222181 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x00000000000fffff Time: 0.32832 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x00000000001effff Time: 0.453879 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x000000000027ffff Time: 0.229257 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x000000000034ffff Time: 0.532288 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x000000000038ffff Time: 0.326683 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x000000000062ffff Time: 0.264535 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x00000000006effff Time: 0.169541 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x000000000086ffff Time: 0.223781 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x000000000089ffff Time: 0.200969 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x00000000009fffff Time: 0.20293 [02/13/2023-19:55:44] [V] [TRT] Tactic: 0x0000000000a2ffff Time: 0.169893 [02/13/2023-19:55:44] [V] [TRT] Fastest Tactic: 0x00000000006effff Time: 0.169541 [02/13/2023-19:55:45] [V] [TRT] --------------- Timing Runner: Conv_181 (CudnnConvolution) [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.419182 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.172965 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.51269 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000004 Time: 12.56 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000005 Time: 2.29511 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.192517 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.417765 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.190112 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x000000000000003a Time: 0.548375 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x000000000000003c Time: 12.6135 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x000000000000003d Time: 2.42793 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x000000000000003e Time: 0.191877 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.417673 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.420681 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.511872 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000074 Time: 11.6545 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000075 Time: 2.08728 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.184809 [02/13/2023-19:55:45] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.172965 [02/13/2023-19:55:45] [V] [TRT] --------------- Timing Runner: Conv_181 (CaskConvolution) [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 0.462679 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 0.486807 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.605317 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x4727434768e46395 Time: 0.288896 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 1.60547 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.784672 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 0.832814 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 0.463173 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 0.646985 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 0.126569 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:55:45] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 0.230761 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.558501 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 1.20763 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 0.433586 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:55:45] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.61429 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.517751 [02/13/2023-19:55:45] [V] [TRT] Fastest Tactic: 0x94119b4c514b211a Time: 0.126569 [02/13/2023-19:55:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94119b4c514b211a [02/13/2023-19:55:45] [V] [TRT] *************** Autotuning format combination: Float(73728,1,4096,128) -> Float(36864,1,2048,64) *************** [02/13/2023-19:55:45] [V] [TRT] --------------- Timing Runner: Conv_181 (CaskConvolution) [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.103479 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.109456 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.219049 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.314574 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.221477 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.131669 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.34885 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.0626941 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.274382 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:55:45] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.0668267 [02/13/2023-19:55:45] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.194885 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.197481 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 0.539438 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.355895 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.230245 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.602715 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.222386 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.20491 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x634e99502974e4da Time: 0.589495 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.195415 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.09336 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.097504 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.0934834 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.0963109 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.0973577 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.579003 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.544645 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.066496 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.195173 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.230149 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.168558 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.144677 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.17056 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.101883 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.16949 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 0.34117 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.10136 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.605024 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.153262 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.304795 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.0929349 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.105243 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.60107 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.127079 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.235301 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.0970674 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.196608 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.31467 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.566286 [02/13/2023-19:55:46] [V] [TRT] Fastest Tactic: 0x2d80d2b384ab13f1 Time: 0.0626941 [02/13/2023-19:55:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:55:46] [V] [TRT] *************** Autotuning format combination: Float(18432,1:4,1024,32) -> Float(9216,1:4,512,16) *************** [02/13/2023-19:55:46] [V] [TRT] --------------- Timing Runner: Conv_181 (CaskConvolution) [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.102354 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.109803 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.221696 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.131275 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.0628038 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.274661 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.0657158 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.194967 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.186816 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.165207 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.0806103 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.0819291 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.0775291 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.0808503 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.0846811 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.0572861 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.195671 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.143479 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.119577 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.143566 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.0878903 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.143776 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.0842423 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.127111 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.0742514 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.0846103 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.101785 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.189586 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.0785646 [02/13/2023-19:55:46] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.158971 [02/13/2023-19:55:46] [V] [TRT] Fastest Tactic: 0x818413b69874bb35 Time: 0.0572861 [02/13/2023-19:55:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x818413b69874bb35 [02/13/2023-19:55:46] [V] [TRT] =============== Computing costs for [02/13/2023-19:55:46] [V] [TRT] *************** Autotuning format combination: Float(36864,576,32,1), Float(73728,576,32,1), Float(73728,576,32,1) -> Float(36864,576,32,1) *************** [02/13/2023-19:55:46] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)) (PointWiseV2) [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136108 [02/13/2023-19:55:46] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0134429 [02/13/2023-19:55:47] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0132389 [02/13/2023-19:55:47] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0134047 [02/13/2023-19:55:47] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0134043 [02/13/2023-19:55:48] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0131699 [02/13/2023-19:55:48] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0136785 [02/13/2023-19:55:48] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.013526 [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0134911 [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0134417 [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0135456 [02/13/2023-19:55:49] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.0131699 [02/13/2023-19:55:49] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)) (PointWise) [02/13/2023-19:55:49] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:55:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:55:49] [V] [TRT] *************** Autotuning format combination: Float(36864,1,2048,64), Float(73728,1,4096,128), Float(73728,1,4096,128) -> Float(36864,1,2048,64) *************** [02/13/2023-19:55:49] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)) (PointWiseV2) [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136748 [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0135289 [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0133556 [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0136017 [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0138053 [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0133964 [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0172846 [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0176747 [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0171418 [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0139815 [02/13/2023-19:55:49] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0137247 [02/13/2023-19:55:49] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.0133556 [02/13/2023-19:55:49] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)) (PointWise) [02/13/2023-19:55:49] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:55:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [02/13/2023-19:55:49] [V] [TRT] *************** Autotuning format combination: Float(9216,1:4,512,16), Float(18432,1:4,1024,32), Float(18432,1:4,1024,32) -> Float(9216,1:4,512,16) *************** [02/13/2023-19:55:49] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)) (PointWiseV2) [02/13/2023-19:55:50] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.016353 [02/13/2023-19:55:50] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0172643 [02/13/2023-19:55:50] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0169519 [02/13/2023-19:55:51] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0172206 [02/13/2023-19:55:51] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0176645 [02/13/2023-19:55:51] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.016734 [02/13/2023-19:55:52] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0175604 [02/13/2023-19:55:52] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0201771 [02/13/2023-19:55:52] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.021169 [02/13/2023-19:55:53] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0210776 [02/13/2023-19:55:53] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0139059 [02/13/2023-19:55:53] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0166552 [02/13/2023-19:55:54] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0147168 [02/13/2023-19:55:54] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0171733 [02/13/2023-19:55:54] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0195011 [02/13/2023-19:55:55] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0194977 [02/13/2023-19:55:55] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0236996 [02/13/2023-19:55:55] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0195851 [02/13/2023-19:55:56] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0195926 [02/13/2023-19:55:56] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0197189 [02/13/2023-19:55:56] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0192411 [02/13/2023-19:55:57] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0154181 [02/13/2023-19:55:57] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0190366 [02/13/2023-19:55:57] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0195326 [02/13/2023-19:55:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0196006 [02/13/2023-19:55:58] [V] [TRT] Tactic: 0x000000000000001d Time: 0.019208 [02/13/2023-19:55:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0191349 [02/13/2023-19:55:58] [V] [TRT] Fastest Tactic: 0x000000000000000a Time: 0.0139059 [02/13/2023-19:55:58] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)) (PointWise) [02/13/2023-19:55:58] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:55:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000a [02/13/2023-19:55:58] [V] [TRT] *************** Autotuning format combination: Float(1152,576:32,32,1), Float(2304,576:32,32,1), Float(2304,576:32,32,1) -> Float(1152,576:32,32,1) *************** [02/13/2023-19:55:58] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)) (PointWiseV2) [02/13/2023-19:55:59] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.019372 [02/13/2023-19:55:59] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0196857 [02/13/2023-19:55:59] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0195263 [02/13/2023-19:56:00] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0283223 [02/13/2023-19:56:00] [V] [TRT] Tactic: 0x000000000000001f Time: 0.023183 [02/13/2023-19:56:00] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.019372 [02/13/2023-19:56:00] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)) (PointWise) [02/13/2023-19:56:00] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [02/13/2023-19:56:00] [V] [TRT] *************** Autotuning format combination: Float(1:4,576,32,1), Float(1:4,576,32,1), Float(1:4,576,32,1) -> Float(1:4,576,32,1) *************** [02/13/2023-19:56:00] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)) (PointWiseV2) [02/13/2023-19:56:00] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.497184 [02/13/2023-19:56:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.589426 [02/13/2023-19:56:01] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.562843 [02/13/2023-19:56:01] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.729079 [02/13/2023-19:56:02] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.751534 [02/13/2023-19:56:02] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.584567 [02/13/2023-19:56:02] [V] [TRT] Tactic: 0x0000000000000006 Time: 1.0093 [02/13/2023-19:56:03] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.971785 [02/13/2023-19:56:03] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.922734 [02/13/2023-19:56:03] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.11138 [02/13/2023-19:56:04] [V] [TRT] Tactic: 0x000000000000000a Time: 0.363899 [02/13/2023-19:56:04] [V] [TRT] Tactic: 0x000000000000000b Time: 0.499575 [02/13/2023-19:56:04] [V] [TRT] Tactic: 0x000000000000000c Time: 0.415771 [02/13/2023-19:56:05] [V] [TRT] Tactic: 0x000000000000000d Time: 0.631305 [02/13/2023-19:56:05] [V] [TRT] Tactic: 0x000000000000000e Time: 0.610336 [02/13/2023-19:56:05] [V] [TRT] Tactic: 0x000000000000000f Time: 0.422144 [02/13/2023-19:56:06] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.894592 [02/13/2023-19:56:06] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.831758 [02/13/2023-19:56:07] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.670432 [02/13/2023-19:56:07] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.511625 [02/13/2023-19:56:07] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.310693 [02/13/2023-19:56:08] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.430126 [02/13/2023-19:56:08] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.53696 [02/13/2023-19:56:08] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.752713 [02/13/2023-19:56:09] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0610377 [02/13/2023-19:56:09] [V] [TRT] Tactic: 0x000000000000001d Time: 0.059232 [02/13/2023-19:56:09] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0490758 [02/13/2023-19:56:09] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.0490758 [02/13/2023-19:56:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [02/13/2023-19:56:09] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:09] [V] [TRT] *************** Autotuning format combination: Float(73728,576,32,1) -> Float(294912,2304,64,1) *************** [02/13/2023-19:56:09] [V] [TRT] --------------- Timing Runner: Resize_190 (Resize) [02/13/2023-19:56:09] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0794857 [02/13/2023-19:56:09] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0794857 [02/13/2023-19:56:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 [02/13/2023-19:56:09] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:09] [V] [TRT] *************** Autotuning format combination: Float(393984,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:56:09] [V] [TRT] --------------- Timing Runner: Conv_200 + Relu_201 (CudaDepthwiseConvolution) [02/13/2023-19:56:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:09] [V] [TRT] --------------- Timing Runner: Conv_200 + Relu_201 (FusedConvActConvolution) [02/13/2023-19:56:09] [V] [TRT] Tactic: 0x000000000007ffff Time: 1.25792 [02/13/2023-19:56:09] [V] [TRT] Tactic: 0x00000000001effff Time: 1.63441 [02/13/2023-19:56:09] [V] [TRT] Fastest Tactic: 0x000000000007ffff Time: 1.25792 [02/13/2023-19:56:09] [V] [TRT] --------------- Timing Runner: Conv_200 + Relu_201 (CudnnConvolution) [02/13/2023-19:56:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.72762 [02/13/2023-19:56:09] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.792736 [02/13/2023-19:56:09] [V] [TRT] Tactic: 0x0000000000000002 Time: 1.86811 [02/13/2023-19:56:11] [V] [TRT] Tactic: 0x0000000000000004 Time: 138.783 [02/13/2023-19:56:11] [V] [TRT] Tactic: 0x0000000000000005 Time: 2.60314 [02/13/2023-19:56:11] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.185051 [02/13/2023-19:56:11] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.414377 [02/13/2023-19:56:11] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.206254 [02/13/2023-19:56:11] [V] [TRT] Tactic: 0x000000000000003a Time: 0.508069 [02/13/2023-19:56:13] [V] [TRT] Tactic: 0x000000000000003c Time: 138.767 [02/13/2023-19:56:13] [V] [TRT] Tactic: 0x000000000000003d Time: 2.59345 [02/13/2023-19:56:13] [V] [TRT] Tactic: 0x000000000000003e Time: 0.183931 [02/13/2023-19:56:13] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.41179 [02/13/2023-19:56:13] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.41163 [02/13/2023-19:56:13] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.508635 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x0000000000000074 Time: 138.636 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x0000000000000075 Time: 2.6627 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.184965 [02/13/2023-19:56:14] [V] [TRT] Fastest Tactic: 0x000000000000003e Time: 0.183931 [02/13/2023-19:56:14] [V] [TRT] --------------- Timing Runner: Conv_200 + Relu_201 (CaskConvolution) [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 0.426642 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 0.431008 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.439429 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x4727434768e46395 Time: 0.394624 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 0.501687 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.485257 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 0.509138 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 0.478336 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 0.410226 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 0.152091 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:56:14] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 0.391877 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.322085 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 0.502958 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 0.579355 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:56:14] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.494368 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.454203 [02/13/2023-19:56:14] [V] [TRT] Fastest Tactic: 0x94119b4c514b211a Time: 0.152091 [02/13/2023-19:56:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94119b4c514b211a [02/13/2023-19:56:14] [V] [TRT] *************** Autotuning format combination: Float(393984,1,10944,171) -> Float(184320,1,5120,80) *************** [02/13/2023-19:56:14] [V] [TRT] --------------- Timing Runner: Conv_200 + Relu_201 (CaskConvolution) [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.37461 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.345728 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 0.659113 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.498921 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.32165 [02/13/2023-19:56:14] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:14] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.43328 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.321755 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.509925 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.347264 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.505586 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.347031 [02/13/2023-19:56:15] [V] [TRT] Fastest Tactic: 0x62835fce994f06dd Time: 0.32165 [02/13/2023-19:56:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x62835fce994f06dd [02/13/2023-19:56:15] [V] [TRT] *************** Autotuning format combination: Float(99072,1:4,2752,43) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:56:15] [V] [TRT] --------------- Timing Runner: Conv_200 + Relu_201 (CaskConvolution) [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.139977 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.154949 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.373531 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.345463 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.104171 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.119538 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.423698 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.1448 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.132169 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.160037 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.323698 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.324672 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 0.660027 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.430885 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.210418 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.498359 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.198258 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.321435 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x634e99502974e4da Time: 0.492695 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.132816 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.133993 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.135691 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.165344 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.17077 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.134965 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.487328 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.433125 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.151707 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.319456 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.206075 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.127554 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.149298 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.127529 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.148375 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.162624 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 0.42133 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.142917 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.508082 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.1552 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.344123 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.129762 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.183442 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.508695 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.118896 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.112512 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.139216 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.181897 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.348439 [02/13/2023-19:56:15] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.486354 [02/13/2023-19:56:15] [V] [TRT] Fastest Tactic: 0x21246c8544eff903 Time: 0.104171 [02/13/2023-19:56:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x21246c8544eff903 [02/13/2023-19:56:15] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:15] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:56:15] [V] [TRT] --------------- Timing Runner: Expand_204 (Slice) [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00696882 [02/13/2023-19:56:15] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00696882 [02/13/2023-19:56:15] [V] [TRT] --------------- Timing Runner: Expand_204 (Padding) [02/13/2023-19:56:15] [V] [TRT] Padding has no valid tactics for this config, skipping [02/13/2023-19:56:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [02/13/2023-19:56:15] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:15] [V] [TRT] *************** Autotuning format combination: Float(184320,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:56:15] [V] [TRT] --------------- Timing Runner: Conv_206 (CudaDepthwiseConvolution) [02/13/2023-19:56:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:15] [V] [TRT] --------------- Timing Runner: Conv_206 (FusedConvActConvolution) [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x000000000007ffff Time: 0.159433 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x00000000000affff Time: 0.165093 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x00000000000effff Time: 0.157531 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x00000000000fffff Time: 0.145851 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x00000000001effff Time: 0.191173 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x000000000027ffff Time: 0.139835 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x000000000034ffff Time: 0.208654 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x000000000038ffff Time: 0.169847 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x000000000062ffff Time: 0.143694 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x00000000006effff Time: 0.17323 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x000000000086ffff Time: 0.191968 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x000000000089ffff Time: 0.140665 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x00000000009fffff Time: 0.1304 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x0000000000a2ffff Time: 0.128446 [02/13/2023-19:56:15] [V] [TRT] Fastest Tactic: 0x0000000000a2ffff Time: 0.128446 [02/13/2023-19:56:15] [V] [TRT] --------------- Timing Runner: Conv_206 (CudnnConvolution) [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.196571 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0937074 [02/13/2023-19:56:15] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.266464 [02/13/2023-19:56:16] [V] [TRT] Tactic: 0x0000000000000004 Time: 64.9468 [02/13/2023-19:56:16] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.28386 [02/13/2023-19:56:16] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0947771 [02/13/2023-19:56:16] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.197463 [02/13/2023-19:56:16] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0979474 [02/13/2023-19:56:16] [V] [TRT] Tactic: 0x000000000000003a Time: 0.266034 [02/13/2023-19:56:16] [V] [TRT] Tactic: 0x000000000000003c Time: 64.4132 [02/13/2023-19:56:16] [V] [TRT] Tactic: 0x000000000000003d Time: 1.28343 [02/13/2023-19:56:16] [V] [TRT] Tactic: 0x000000000000003e Time: 0.0948937 [02/13/2023-19:56:16] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.197289 [02/13/2023-19:56:16] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.196997 [02/13/2023-19:56:16] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.264398 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x0000000000000074 Time: 64.9445 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x0000000000000075 Time: 1.27988 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.0945029 [02/13/2023-19:56:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0937074 [02/13/2023-19:56:17] [V] [TRT] --------------- Timing Runner: Conv_206 (CaskConvolution) [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 0.209211 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 0.212521 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.212521 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x4727434768e46395 Time: 0.19211 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 0.245211 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.234345 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 0.247616 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 0.200786 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 0.198377 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 0.0770537 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 0.191255 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.156457 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 0.246528 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 0.277938 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.238473 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.219488 [02/13/2023-19:56:17] [V] [TRT] Fastest Tactic: 0x94119b4c514b211a Time: 0.0770537 [02/13/2023-19:56:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94119b4c514b211a [02/13/2023-19:56:17] [V] [TRT] *************** Autotuning format combination: Float(184320,1,5120,80) -> Float(184320,1,5120,80) *************** [02/13/2023-19:56:17] [V] [TRT] --------------- Timing Runner: Conv_206 (CaskConvolution) [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.0736023 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.0799223 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.17861 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.165883 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.0576823 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.0648122 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.199771 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.0907246 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.0689097 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.101461 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.170085 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.170656 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 0.324023 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.202048 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.111337 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.233138 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.108203 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.15483 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x634e99502974e4da Time: 0.230793 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.0584838 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.0689996 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.0711238 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.0995634 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.103577 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.0699749 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.227657 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.20848 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.09616 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.151991 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.111543 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.0579535 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.0731131 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.0587261 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.0921691 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.0829943 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 0.197541 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.0885371 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.236027 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.0772686 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.164494 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.0667749 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.116395 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.236279 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.0623787 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:17] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.0602164 [02/13/2023-19:56:17] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.0858674 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.0953326 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.165522 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.22672 [02/13/2023-19:56:18] [V] [TRT] Fastest Tactic: 0x21246c8544eff903 Time: 0.0576823 [02/13/2023-19:56:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x21246c8544eff903 [02/13/2023-19:56:18] [V] [TRT] *************** Autotuning format combination: Float(46080,1:4,1280,20) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:56:18] [V] [TRT] --------------- Timing Runner: Conv_206 (CaskConvolution) [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.0734149 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.0797783 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.0577707 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.064512 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.0903314 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.0686705 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.100912 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.110832 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.107193 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.058659 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.0691307 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.0709394 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.0993029 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.103593 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.0699413 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.0958354 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.111234 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.058371 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.0727748 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.0586011 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.0919406 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.083008 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.0893806 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.0772251 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.0670918 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.117083 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.0625935 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.0602956 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.085904 [02/13/2023-19:56:18] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.0954377 [02/13/2023-19:56:18] [V] [TRT] Fastest Tactic: 0x21246c8544eff903 Time: 0.0577707 [02/13/2023-19:56:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x21246c8544eff903 [02/13/2023-19:56:18] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:18] [V] [TRT] *************** Autotuning format combination: Float(184320,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:56:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207) (PointWiseV2) [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00985051 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00835149 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00752962 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00752698 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.007368 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00716914 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00736366 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00732869 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00722926 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00724754 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00996145 [02/13/2023-19:56:18] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00716914 [02/13/2023-19:56:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207) (PointWise) [02/13/2023-19:56:18] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:56:18] [V] [TRT] *************** Autotuning format combination: Float(184320,1,5120,80) -> Float(184320,1,5120,80) *************** [02/13/2023-19:56:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207) (PointWiseV2) [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00999832 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00825702 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00772427 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00761095 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00725851 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00722263 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0072736 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00721211 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00718789 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00734743 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0098048 [02/13/2023-19:56:18] [V] [TRT] Fastest Tactic: 0x0000000000000008 Time: 0.00718789 [02/13/2023-19:56:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207) (PointWise) [02/13/2023-19:56:18] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000008 [02/13/2023-19:56:18] [V] [TRT] *************** Autotuning format combination: Float(46080,1:4,1280,20) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:56:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207) (PointWiseV2) [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00993493 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00992853 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00993402 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00962164 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0102433 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0106557 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0098435 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00995992 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0103229 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.010335 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0097347 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00973227 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00995718 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00970362 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00994011 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00994133 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00968716 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00968107 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0102073 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0105502 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.011372 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00936171 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00777961 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00767687 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00990659 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00966126 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0104085 [02/13/2023-19:56:18] [V] [TRT] Fastest Tactic: 0x0000000000000017 Time: 0.00767687 [02/13/2023-19:56:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207) (PointWise) [02/13/2023-19:56:18] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000017 [02/13/2023-19:56:18] [V] [TRT] *************** Autotuning format combination: Float(6912,2304:32,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:56:18] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207) (PointWiseV2) [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0110664 [02/13/2023-19:56:18] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0114374 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0112246 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0122926 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0110312 [02/13/2023-19:56:19] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0110312 [02/13/2023-19:56:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207) (PointWise) [02/13/2023-19:56:19] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [02/13/2023-19:56:19] [V] [TRT] *************** Autotuning format combination: Float(1:4,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:56:19] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_207) (PointWiseV2) [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.378217 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.443927 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.501157 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.518519 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.661573 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.506935 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.667383 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.870363 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.825262 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.668325 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x000000000000000a Time: 0.358999 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x000000000000000b Time: 0.484827 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x000000000000000c Time: 0.417435 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x000000000000000d Time: 0.66656 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x000000000000000e Time: 0.546587 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x000000000000000f Time: 0.427931 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000010 Time: 1.04036 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.722834 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.616658 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.501047 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.318094 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.420009 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.575191 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.896974 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0393406 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0366469 [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0494949 [02/13/2023-19:56:19] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.0366469 [02/13/2023-19:56:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [02/13/2023-19:56:19] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:19] [V] [TRT] *************** Autotuning format combination: Float(184320,2304,64,1), Float(184320,2304,64,1) -> Float(184320,2304,64,1) *************** [02/13/2023-19:56:19] [V] [TRT] --------------- Timing Runner: Mul_209 (ElementWise) [02/13/2023-19:56:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00704283 [02/13/2023-19:56:19] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.00704283 [02/13/2023-19:56:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:56:19] [V] [TRT] *************** Autotuning format combination: Float(46080,1:4,1280,20), Float(46080,1:4,1280,20) -> Float(46080,1:4,1280,20) *************** [02/13/2023-19:56:19] [V] [TRT] --------------- Timing Runner: Mul_209 (ElementWise) [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00831924 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0159873 [02/13/2023-19:56:20] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.00831924 [02/13/2023-19:56:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:56:20] [V] [TRT] *************** Autotuning format combination: Float(6912,2304:32,64,1), Float(6912,2304:32,64,1) -> Float(6912,2304:32,64,1) *************** [02/13/2023-19:56:20] [V] [TRT] --------------- Timing Runner: Mul_209 (ElementWise) [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0109969 [02/13/2023-19:56:20] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0109969 [02/13/2023-19:56:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:56:20] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:20] [V] [TRT] *************** Autotuning format combination: Float(184320,2304,64,1) -> Float(92160,2304,64,1) *************** [02/13/2023-19:56:20] [V] [TRT] --------------- Timing Runner: Conv_211 (CudaDepthwiseConvolution) [02/13/2023-19:56:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:20] [V] [TRT] --------------- Timing Runner: Conv_211 (FusedConvActConvolution) [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x000000000007ffff Time: 0.096112 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x00000000000affff Time: 0.0882926 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x00000000000effff Time: 0.0837691 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x00000000000fffff Time: 0.105111 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x00000000001effff Time: 0.109029 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x000000000027ffff Time: 0.0977463 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x000000000034ffff Time: 0.183858 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x000000000038ffff Time: 0.143867 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x000000000062ffff Time: 0.0994811 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x00000000006effff Time: 0.092512 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x000000000086ffff Time: 0.127771 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x000000000089ffff Time: 0.0965463 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x00000000009fffff Time: 0.089296 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000a2ffff Time: 0.0891269 [02/13/2023-19:56:20] [V] [TRT] Fastest Tactic: 0x00000000000effff Time: 0.0837691 [02/13/2023-19:56:20] [V] [TRT] --------------- Timing Runner: Conv_211 (CudnnConvolution) [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.145253 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.063264 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.207241 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000004 Time: 9.73285 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.739474 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.07432 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.14464 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0627337 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x000000000000003a Time: 0.197509 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x000000000000003c Time: 9.9937 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x000000000000003d Time: 0.738734 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x000000000000003e Time: 0.0745074 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.145463 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.145714 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.197563 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000074 Time: 9.68442 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.743314 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.0742149 [02/13/2023-19:56:20] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.0627337 [02/13/2023-19:56:20] [V] [TRT] --------------- Timing Runner: Conv_211 (CaskConvolution) [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 0.200407 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 0.140059 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.140288 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x4727434768e46395 Time: 0.116942 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 0.243771 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.234587 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 0.247127 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 0.208297 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 0.138176 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 0.0595627 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 0.116686 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.154469 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 0.245266 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 0.160791 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.237952 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.144165 [02/13/2023-19:56:20] [V] [TRT] Fastest Tactic: 0x94119b4c514b211a Time: 0.0595627 [02/13/2023-19:56:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94119b4c514b211a [02/13/2023-19:56:20] [V] [TRT] *************** Autotuning format combination: Float(184320,1,5120,80) -> Float(92160,1,2560,40) *************** [02/13/2023-19:56:20] [V] [TRT] --------------- Timing Runner: Conv_211 (CaskConvolution) [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.072944 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.0540069 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.108997 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.113335 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.0562225 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.064605 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.135465 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.0561707 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.0685074 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.0624168 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.129488 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.130414 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 0.323351 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.138041 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.110871 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.231927 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.107264 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.0957028 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x634e99502974e4da Time: 0.229783 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.0592579 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.0687589 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.0487192 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.0714674 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.074992 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.0476922 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.22704 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.115035 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.0602667 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.0952594 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.111563 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.0558674 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.0390411 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.057155 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.0627261 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.0433577 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 0.134679 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.0623071 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.237088 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.0407417 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.1648 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.0668678 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.0842491 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.23579 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.0629821 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.0604206 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.0594956 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.0949783 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.11387 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.225531 [02/13/2023-19:56:20] [V] [TRT] Fastest Tactic: 0xa9a06d0633580c0c Time: 0.0390411 [02/13/2023-19:56:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:20] [V] [TRT] *************** Autotuning format combination: Float(46080,1:4,1280,20) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:56:20] [V] [TRT] --------------- Timing Runner: Conv_211 (CaskConvolution) [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.0729166 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:20] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.054045 [02/13/2023-19:56:20] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.0571596 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.0649783 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.0561524 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.0686339 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.0624579 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.111079 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.107611 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.0594789 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.0689143 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.048893 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.0718789 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.0750491 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.047645 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.0601768 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.111899 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.056099 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:21] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.0391417 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:21] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.0570545 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:21] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.0634728 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.0432743 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:21] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.0621714 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.0411406 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:21] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.0666392 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.0850354 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.0629745 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.0604008 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.0595657 [02/13/2023-19:56:21] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.0944343 [02/13/2023-19:56:21] [V] [TRT] Fastest Tactic: 0xa9a06d0633580c0c Time: 0.0391417 [02/13/2023-19:56:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:21] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:21] [V] [TRT] *************** Autotuning format combination: Float(92160,2304,64,1), Float(184320,2304,64,1), Float(184320,2304,64,1) -> Float(92160,2304,64,1) *************** [02/13/2023-19:56:21] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) (PointWiseV2) [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00916914 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00740457 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00727086 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00712882 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00719131 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00689132 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00705959 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0071212 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00709464 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00712424 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x000000000000001c Time: 0.009046 [02/13/2023-19:56:21] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00689132 [02/13/2023-19:56:21] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) (PointWise) [02/13/2023-19:56:21] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:56:21] [V] [TRT] *************** Autotuning format combination: Float(92160,1,2560,40), Float(184320,1,5120,80), Float(184320,1,5120,80) -> Float(92160,1,2560,40) *************** [02/13/2023-19:56:21] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) (PointWiseV2) [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116761 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00953691 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00935943 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0115924 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0117349 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00972617 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0138082 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0156791 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0137808 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0135925 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00914029 [02/13/2023-19:56:21] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00914029 [02/13/2023-19:56:21] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) (PointWise) [02/13/2023-19:56:21] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:56:21] [V] [TRT] *************** Autotuning format combination: Float(23040,1:4,640,10), Float(46080,1:4,1280,20), Float(46080,1:4,1280,20) -> Float(23040,1:4,640,10) *************** [02/13/2023-19:56:21] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) (PointWiseV2) [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.017279 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0168112 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0170433 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.016994 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0174298 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.016131 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.017827 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0196434 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0185943 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0223256 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0122552 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0129048 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x000000000000000c Time: 0.012704 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0143397 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0141058 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x000000000000000f Time: 0.012515 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0203457 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0147209 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0140659 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0136632 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0134018 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0117482 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0117971 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0155241 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x000000000000001c Time: 0.011957 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0106132 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00947971 [02/13/2023-19:56:21] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00947971 [02/13/2023-19:56:21] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) (PointWise) [02/13/2023-19:56:21] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [02/13/2023-19:56:21] [V] [TRT] *************** Autotuning format combination: Float(4608,2304:32,64,1), Float(6912,2304:32,64,1), Float(6912,2304:32,64,1) -> Float(4608,2304:32,64,1) *************** [02/13/2023-19:56:21] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) (PointWiseV2) [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.016641 [02/13/2023-19:56:21] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0161686 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0145897 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0159258 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0177097 [02/13/2023-19:56:22] [V] [TRT] Fastest Tactic: 0x000000000000001a Time: 0.0145897 [02/13/2023-19:56:22] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) (PointWise) [02/13/2023-19:56:22] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001a [02/13/2023-19:56:22] [V] [TRT] *************** Autotuning format combination: Float(1:4,2304,64,1), Float(1:4,2304,64,1), Float(1:4,2304,64,1) -> Float(1:4,2304,64,1) *************** [02/13/2023-19:56:22] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) (PointWiseV2) [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.340873 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.381298 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.369518 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.451072 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.480558 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.382743 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.598263 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.586601 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.605819 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.779026 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x000000000000000a Time: 0.221435 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x000000000000000b Time: 0.29435 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x000000000000000c Time: 0.248667 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x000000000000000d Time: 0.370336 [02/13/2023-19:56:22] [V] [TRT] Tactic: 0x000000000000000e Time: 0.358501 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x000000000000000f Time: 0.253586 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.523785 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.487063 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.416576 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.337285 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.192827 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.256553 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.316338 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.441874 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0517531 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0418731 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0378103 [02/13/2023-19:56:23] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.0378103 [02/13/2023-19:56:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [02/13/2023-19:56:23] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:23] [V] [TRT] *************** Autotuning format combination: Float(184320,2304,64,1) -> Float(737280,9216,128,1) *************** [02/13/2023-19:56:23] [V] [TRT] --------------- Timing Runner: Resize_220 (Resize) [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.043584 [02/13/2023-19:56:23] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.043584 [02/13/2023-19:56:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 [02/13/2023-19:56:23] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:23] [V] [TRT] *************** Autotuning format combination: Float(986112,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:56:23] [V] [TRT] --------------- Timing Runner: Conv_230 + Relu_231 (CudaDepthwiseConvolution) [02/13/2023-19:56:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:23] [V] [TRT] --------------- Timing Runner: Conv_230 + Relu_231 (FusedConvActConvolution) [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x000000000007ffff Time: 0.500338 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x00000000001effff Time: 0.470491 [02/13/2023-19:56:23] [V] [TRT] Fastest Tactic: 0x00000000001effff Time: 0.470491 [02/13/2023-19:56:23] [V] [TRT] --------------- Timing Runner: Conv_230 + Relu_231 (CudnnConvolution) [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.647301 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.277115 [02/13/2023-19:56:23] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.863397 [02/13/2023-19:56:24] [V] [TRT] Tactic: 0x0000000000000004 Time: 81.489 [02/13/2023-19:56:24] [V] [TRT] Tactic: 0x0000000000000005 Time: 2.18849 [02/13/2023-19:56:24] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.260841 [02/13/2023-19:56:24] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.644841 [02/13/2023-19:56:24] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.278039 [02/13/2023-19:56:24] [V] [TRT] Tactic: 0x000000000000003a Time: 0.859122 [02/13/2023-19:56:25] [V] [TRT] Tactic: 0x000000000000003c Time: 79.9317 [02/13/2023-19:56:25] [V] [TRT] Tactic: 0x000000000000003d Time: 2.17287 [02/13/2023-19:56:25] [V] [TRT] Tactic: 0x000000000000003e Time: 0.262711 [02/13/2023-19:56:25] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.646939 [02/13/2023-19:56:25] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.464 [02/13/2023-19:56:25] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.872613 [02/13/2023-19:56:26] [V] [TRT] Tactic: 0x0000000000000074 Time: 81.8163 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x0000000000000075 Time: 2.1939 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.261778 [02/13/2023-19:56:27] [V] [TRT] Fastest Tactic: 0x0000000000000006 Time: 0.260841 [02/13/2023-19:56:27] [V] [TRT] --------------- Timing Runner: Conv_230 + Relu_231 (CaskConvolution) [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 0.849088 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 0.496197 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.457701 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x4727434768e46395 Time: 0.45264 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 0.961271 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.766482 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 0.813134 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 0.847506 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 0.428713 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 0.221358 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 0.449719 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.534798 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 0.974894 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 0.626683 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.777902 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.469819 [02/13/2023-19:56:27] [V] [TRT] Fastest Tactic: 0x94119b4c514b211a Time: 0.221358 [02/13/2023-19:56:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94119b4c514b211a [02/13/2023-19:56:27] [V] [TRT] *************** Autotuning format combination: Float(986112,1,13696,107) -> Float(368640,1,5120,40) *************** [02/13/2023-19:56:27] [V] [TRT] --------------- Timing Runner: Conv_230 + Relu_231 (CaskConvolution) [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.432539 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.376846 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 1.39973 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.796439 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.374281 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.466747 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.370487 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.809134 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.662587 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.808151 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.376919 [02/13/2023-19:56:27] [V] [TRT] Fastest Tactic: 0x94a7db94ba744c45 Time: 0.370487 [02/13/2023-19:56:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:27] [V] [TRT] *************** Autotuning format combination: Float(248832,1:4,3456,27) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:56:27] [V] [TRT] --------------- Timing Runner: Conv_230 + Relu_231 (CaskConvolution) [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.283977 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.184978 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.430309 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.376219 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.220654 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.209042 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.455895 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.196553 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.267534 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.208942 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.49248 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.494587 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 1.40681 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.461765 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.365143 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.798624 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.348704 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.375525 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x634e99502974e4da Time: 0.78709 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.218226 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.274336 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.174094 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.284933 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.296626 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.169125 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.777381 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.467438 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.203717 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.370048 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.359081 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.202336 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.168965 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.207154 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.183918 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.182181 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 0.45168 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.179438 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.809248 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.176974 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.661312 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.263575 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.326871 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.808096 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.203159 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.231799 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.174807 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.308882 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.376146 [02/13/2023-19:56:27] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.774299 [02/13/2023-19:56:27] [V] [TRT] Fastest Tactic: 0xa9a06d0633580c0c Time: 0.168965 [02/13/2023-19:56:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:27] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:27] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:56:27] [V] [TRT] --------------- Timing Runner: Expand_234 (Slice) [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00943086 [02/13/2023-19:56:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00943086 [02/13/2023-19:56:27] [V] [TRT] --------------- Timing Runner: Expand_234 (Padding) [02/13/2023-19:56:27] [V] [TRT] Padding has no valid tactics for this config, skipping [02/13/2023-19:56:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [02/13/2023-19:56:27] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:27] [V] [TRT] *************** Autotuning format combination: Float(368640,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:56:27] [V] [TRT] --------------- Timing Runner: Conv_236 (CudaDepthwiseConvolution) [02/13/2023-19:56:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:27] [V] [TRT] --------------- Timing Runner: Conv_236 (FusedConvActConvolution) [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x000000000007ffff Time: 0.211346 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x00000000000affff Time: 0.201093 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x00000000000effff Time: 0.182912 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x00000000000fffff Time: 0.185522 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x00000000001effff Time: 0.241509 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x000000000027ffff Time: 0.18512 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x000000000034ffff Time: 0.327314 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x000000000038ffff Time: 0.272183 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x000000000062ffff Time: 0.189097 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x00000000006effff Time: 0.211529 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x000000000086ffff Time: 0.253042 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x000000000089ffff Time: 0.181129 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x00000000009fffff Time: 0.176507 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x0000000000a2ffff Time: 0.183849 [02/13/2023-19:56:27] [V] [TRT] Fastest Tactic: 0x00000000009fffff Time: 0.176507 [02/13/2023-19:56:27] [V] [TRT] --------------- Timing Runner: Conv_236 (CudnnConvolution) [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.251735 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.114757 [02/13/2023-19:56:27] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.342715 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x0000000000000004 Time: 22.0643 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.06635 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.115205 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.250597 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.114663 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x000000000000003a Time: 0.342569 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x000000000000003c Time: 22.8849 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x000000000000003d Time: 1.06147 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x000000000000003e Time: 0.116443 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.250071 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.190418 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.345253 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x0000000000000074 Time: 22.149 [02/13/2023-19:56:28] [V] [TRT] Tactic: 0x0000000000000075 Time: 1.06074 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.116434 [02/13/2023-19:56:29] [V] [TRT] Fastest Tactic: 0x0000000000000039 Time: 0.114663 [02/13/2023-19:56:29] [V] [TRT] --------------- Timing Runner: Conv_236 (CaskConvolution) [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 0.312498 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 0.189298 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.176832 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x4727434768e46395 Time: 0.180855 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 0.387767 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.298034 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 0.325353 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 0.344238 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 0.169353 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 0.0941783 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 0.180741 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.193083 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 0.390565 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 0.247109 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.303008 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.181682 [02/13/2023-19:56:29] [V] [TRT] Fastest Tactic: 0x94119b4c514b211a Time: 0.0941783 [02/13/2023-19:56:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94119b4c514b211a [02/13/2023-19:56:29] [V] [TRT] *************** Autotuning format combination: Float(368640,1,5120,40) -> Float(368640,1,5120,40) *************** [02/13/2023-19:56:29] [V] [TRT] --------------- Timing Runner: Conv_236 (CaskConvolution) [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.154277 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.0958926 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.164786 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.147931 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.117387 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.114839 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.202843 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.0953486 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.14021 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.102873 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.257824 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.25723 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 0.576622 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.204782 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.192096 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.293614 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.186629 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.146249 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x634e99502974e4da Time: 0.288841 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.0983931 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.144343 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.0868411 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.147726 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.156352 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.0847817 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.286665 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.177061 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.100553 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.142681 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.194967 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.0885097 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.0797326 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.0918171 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.0866514 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.0884046 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 0.20293 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.0855383 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.299099 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.0842309 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.257175 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.138907 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.171717 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.298578 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.111557 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.125824 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.0827406 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.165577 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.148302 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.286245 [02/13/2023-19:56:29] [V] [TRT] Fastest Tactic: 0xa9a06d0633580c0c Time: 0.0797326 [02/13/2023-19:56:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:29] [V] [TRT] *************** Autotuning format combination: Float(92160,1:4,1280,10) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:56:29] [V] [TRT] --------------- Timing Runner: Conv_236 (CaskConvolution) [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.157061 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.0954171 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.117477 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.114896 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.0947589 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.13992 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.104379 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.192507 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.187351 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.0984686 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.144974 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.087056 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.150523 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.157033 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.085344 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.10093 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.195177 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.0886011 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.0800914 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.091152 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.0865143 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.088096 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.0857783 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.0845006 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.138103 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.172786 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.112766 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.12467 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.082912 [02/13/2023-19:56:29] [V] [TRT] Conv_236 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.165001 [02/13/2023-19:56:29] [V] [TRT] Fastest Tactic: 0xa9a06d0633580c0c Time: 0.0800914 [02/13/2023-19:56:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:29] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:29] [V] [TRT] *************** Autotuning format combination: Float(368640,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:56:29] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_237) (PointWiseV2) [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0159355 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0122587 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0115432 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0111353 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0108483 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0108797 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0111849 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0108216 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0111251 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.011321 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0153074 [02/13/2023-19:56:29] [V] [TRT] Fastest Tactic: 0x0000000000000007 Time: 0.0108216 [02/13/2023-19:56:29] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_237) (PointWise) [02/13/2023-19:56:29] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000007 [02/13/2023-19:56:29] [V] [TRT] *************** Autotuning format combination: Float(368640,1,5120,40) -> Float(368640,1,5120,40) *************** [02/13/2023-19:56:29] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_237) (PointWiseV2) [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0162799 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0124103 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0115221 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0113561 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0110143 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0108705 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0111311 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0111181 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0110716 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0108202 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000001c Time: 0.015339 [02/13/2023-19:56:29] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.0108202 [02/13/2023-19:56:29] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_237) (PointWise) [02/13/2023-19:56:29] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [02/13/2023-19:56:29] [V] [TRT] *************** Autotuning format combination: Float(92160,1:4,1280,10) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:56:29] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_237) (PointWiseV2) [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0161493 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0165242 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0181549 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.016385 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0185789 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0251192 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0158817 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0167583 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0194857 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0259093 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0157536 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0159431 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0170453 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0160391 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0161392 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0189411 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0172627 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0163825 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0192846 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0240267 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0170174 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0143758 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0120457 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.011947 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0160279 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0159243 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0172577 [02/13/2023-19:56:29] [V] [TRT] Fastest Tactic: 0x0000000000000017 Time: 0.011947 [02/13/2023-19:56:29] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_237) (PointWise) [02/13/2023-19:56:29] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000017 [02/13/2023-19:56:29] [V] [TRT] *************** Autotuning format combination: Float(18432,9216:32,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:56:29] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_237) (PointWiseV2) [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0323785 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0324443 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0323904 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0314085 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0326674 [02/13/2023-19:56:29] [V] [TRT] Fastest Tactic: 0x000000000000001b Time: 0.0314085 [02/13/2023-19:56:29] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_237) (PointWise) [02/13/2023-19:56:29] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001b [02/13/2023-19:56:29] [V] [TRT] *************** Autotuning format combination: Float(1:4,9216,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:56:29] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_237) (PointWiseV2) [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.749861 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.882555 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.996133 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000003 Time: 1.03046 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.31808 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.00729 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000006 Time: 1.32904 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000007 Time: 1.73417 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000008 Time: 1.64347 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.3296 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000000a Time: 0.711854 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000000b Time: 0.964361 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000000c Time: 0.828005 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000000d Time: 1.32741 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000000e Time: 1.08731 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000000f Time: 0.851534 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000010 Time: 2.07522 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000011 Time: 1.4407 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000012 Time: 1.22763 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.995552 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.628997 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.834354 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000016 Time: 1.14347 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x0000000000000017 Time: 1.78695 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0719406 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0698057 [02/13/2023-19:56:29] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0930057 [02/13/2023-19:56:30] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.0698057 [02/13/2023-19:56:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [02/13/2023-19:56:30] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:30] [V] [TRT] *************** Autotuning format combination: Float(368640,9216,128,1), Float(368640,9216,128,1) -> Float(368640,9216,128,1) *************** [02/13/2023-19:56:30] [V] [TRT] --------------- Timing Runner: Mul_239 (ElementWise) [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00942743 [02/13/2023-19:56:30] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.00942743 [02/13/2023-19:56:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:56:30] [V] [TRT] *************** Autotuning format combination: Float(92160,1:4,1280,10), Float(92160,1:4,1280,10) -> Float(92160,1:4,1280,10) *************** [02/13/2023-19:56:30] [V] [TRT] --------------- Timing Runner: Mul_239 (ElementWise) [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0208934 [02/13/2023-19:56:30] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0208934 [02/13/2023-19:56:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:56:30] [V] [TRT] *************** Autotuning format combination: Float(18432,9216:32,128,1), Float(18432,9216:32,128,1) -> Float(18432,9216:32,128,1) *************** [02/13/2023-19:56:30] [V] [TRT] --------------- Timing Runner: Mul_239 (ElementWise) [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0160223 [02/13/2023-19:56:30] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0160223 [02/13/2023-19:56:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:56:30] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:30] [V] [TRT] *************** Autotuning format combination: Float(368640,9216,128,1) -> Float(184320,9216,128,1) *************** [02/13/2023-19:56:30] [V] [TRT] --------------- Timing Runner: Conv_241 (CudaDepthwiseConvolution) [02/13/2023-19:56:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:30] [V] [TRT] --------------- Timing Runner: Conv_241 (FusedConvActConvolution) [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x000000000007ffff Time: 0.11845 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x00000000000affff Time: 0.144581 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x00000000000effff Time: 0.150299 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x00000000000fffff Time: 0.103637 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x00000000001effff Time: 0.171461 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x000000000027ffff Time: 0.0959954 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x000000000034ffff Time: 0.296736 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x000000000038ffff Time: 0.261047 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x000000000062ffff Time: 0.102999 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x00000000006effff Time: 0.173797 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x000000000086ffff Time: 0.131218 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x000000000089ffff Time: 0.0932754 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x00000000009fffff Time: 0.0913829 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000a2ffff Time: 0.0897554 [02/13/2023-19:56:30] [V] [TRT] Fastest Tactic: 0x0000000000a2ffff Time: 0.0897554 [02/13/2023-19:56:30] [V] [TRT] --------------- Timing Runner: Conv_241 (CudnnConvolution) [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.133504 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0886834 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.240091 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000004 Time: 11.043 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.545577 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0716549 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.134016 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.0893074 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x000000000000003a Time: 0.239643 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x000000000000003c Time: 11.4815 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x000000000000003d Time: 0.57013 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x000000000000003e Time: 0.0719383 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.133865 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.138933 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.238843 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000074 Time: 11.0374 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.552229 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.0725943 [02/13/2023-19:56:30] [V] [TRT] Fastest Tactic: 0x0000000000000006 Time: 0.0716549 [02/13/2023-19:56:30] [V] [TRT] --------------- Timing Runner: Conv_241 (CaskConvolution) [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 0.312183 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 0.188759 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.176919 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x4727434768e46395 Time: 0.180096 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 0.3864 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.298094 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 0.325563 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 0.343762 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 0.169106 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 0.0555337 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:56:30] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 0.180626 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.122837 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 0.389074 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 0.247328 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:56:30] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.302757 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.181518 [02/13/2023-19:56:30] [V] [TRT] Fastest Tactic: 0x94119b4c514b211a Time: 0.0555337 [02/13/2023-19:56:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94119b4c514b211a [02/13/2023-19:56:30] [V] [TRT] *************** Autotuning format combination: Float(368640,1,5120,40) -> Float(184320,1,2560,20) *************** [02/13/2023-19:56:30] [V] [TRT] --------------- Timing Runner: Conv_241 (CaskConvolution) [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.153691 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.0957714 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.165065 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.147607 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.116208 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.114802 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.202715 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.0936571 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.139568 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.103195 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.146757 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.145838 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 0.568759 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.204777 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.19189 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.293426 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.18709 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.144649 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x634e99502974e4da Time: 0.288215 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.0975909 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.14453 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.086336 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.0762011 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.0799954 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.0841783 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.286656 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.177042 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.0991977 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.142059 [02/13/2023-19:56:30] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:30] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.194459 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.0874354 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.079072 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.0902354 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.0862331 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.0874263 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 0.202002 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.0843474 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.298446 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.08312 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.256517 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.138247 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.0877623 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.29797 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.110967 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.123609 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.0815406 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.164896 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.147424 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.285742 [02/13/2023-19:56:31] [V] [TRT] Fastest Tactic: 0x679a281f7660c436 Time: 0.0762011 [02/13/2023-19:56:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x679a281f7660c436 [02/13/2023-19:56:31] [V] [TRT] *************** Autotuning format combination: Float(92160,1:4,1280,10) -> Float(46080,1:4,640,5) *************** [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: Conv_241 (CaskConvolution) [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.154213 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.0957189 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.116869 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.114487 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.094128 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.139451 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.103746 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.192457 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.187045 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.097456 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.144878 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.0855017 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.0767223 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.0807337 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.0838126 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.099632 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.19536 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.0878446 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.0792343 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.0903223 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.0855154 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.0877303 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.0849097 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.0835063 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.138395 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.0883566 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.111506 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.124185 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.0813897 [02/13/2023-19:56:31] [V] [TRT] Conv_241 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.165106 [02/13/2023-19:56:31] [V] [TRT] Fastest Tactic: 0x679a281f7660c436 Time: 0.0767223 [02/13/2023-19:56:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x679a281f7660c436 [02/13/2023-19:56:31] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:31] [V] [TRT] *************** Autotuning format combination: Float(184320,9216,128,1), Float(368640,9216,128,1), Float(368640,9216,128,1) -> Float(184320,9216,128,1) *************** [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_242), Mul_246), PWN(PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245), Add_247)) (PointWiseV2) [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136291 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0106766 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00964663 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00929857 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.009512 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00956983 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00984259 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00930657 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00928286 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00957623 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0125055 [02/13/2023-19:56:31] [V] [TRT] Fastest Tactic: 0x0000000000000008 Time: 0.00928286 [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_242), Mul_246), PWN(PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245), Add_247)) (PointWise) [02/13/2023-19:56:31] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000008 [02/13/2023-19:56:31] [V] [TRT] *************** Autotuning format combination: Float(184320,1,2560,20), Float(368640,1,5120,40), Float(368640,1,5120,40) -> Float(184320,1,2560,20) *************** [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_242), Mul_246), PWN(PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245), Add_247)) (PointWiseV2) [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236278 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0266324 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0253676 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0321984 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0341349 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0280503 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.041448 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0481402 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0420686 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0384103 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0175096 [02/13/2023-19:56:31] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0175096 [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_242), Mul_246), PWN(PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245), Add_247)) (PointWise) [02/13/2023-19:56:31] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:56:31] [V] [TRT] *************** Autotuning format combination: Float(46080,1:4,640,5), Float(92160,1:4,1280,10), Float(92160,1:4,1280,10) -> Float(46080,1:4,640,5) *************** [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_242), Mul_246), PWN(PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245), Add_247)) (PointWiseV2) [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0424537 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0424217 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.043544 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0448206 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0528564 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0453714 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0530057 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0624305 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0654019 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0854354 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0359566 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0368251 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0348206 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000000d Time: 0.045552 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0387109 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0367703 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0643962 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.047875 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0464789 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0443783 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0247497 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0307922 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.033141 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0447531 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000001c Time: 0.032352 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0243474 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0167472 [02/13/2023-19:56:31] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.0167472 [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_242), Mul_246), PWN(PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245), Add_247)) (PointWise) [02/13/2023-19:56:31] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [02/13/2023-19:56:31] [V] [TRT] *************** Autotuning format combination: Float(9216,9216:32,128,1), Float(18432,9216:32,128,1), Float(18432,9216:32,128,1) -> Float(9216,9216:32,128,1) *************** [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_242), Mul_246), PWN(PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245), Add_247)) (PointWiseV2) [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0420583 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0409383 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000001a Time: 0.036176 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0344082 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0415863 [02/13/2023-19:56:31] [V] [TRT] Fastest Tactic: 0x000000000000001b Time: 0.0344082 [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_242), Mul_246), PWN(PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245), Add_247)) (PointWise) [02/13/2023-19:56:31] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001b [02/13/2023-19:56:31] [V] [TRT] *************** Autotuning format combination: Float(1:4,9216,128,1), Float(1:4,9216,128,1), Float(1:4,9216,128,1) -> Float(1:4,9216,128,1) *************** [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_242), Mul_246), PWN(PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245), Add_247)) (PointWiseV2) [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.677861 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.754121 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.735781 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.904018 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.95461 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.755639 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000006 Time: 1.1823 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000007 Time: 1.15858 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000008 Time: 1.203 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.55168 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000000a Time: 0.435584 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000000b Time: 0.583625 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000000c Time: 0.491241 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000000d Time: 0.734446 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000000e Time: 0.711314 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000000f Time: 0.501984 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000010 Time: 1.04191 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.968681 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.826601 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.669061 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.380485 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.505733 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.626944 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.877061 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000001c Time: 0.100379 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0767223 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0686964 [02/13/2023-19:56:31] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.0686964 [02/13/2023-19:56:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [02/13/2023-19:56:31] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:31] [V] [TRT] *************** Autotuning format combination: Float(368640,9216,128,1) -> Float(1474560,36864,256,1) *************** [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: Resize_250 (Resize) [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0964617 [02/13/2023-19:56:31] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0964617 [02/13/2023-19:56:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 [02/13/2023-19:56:31] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:31] [V] [TRT] *************** Autotuning format combination: Float(2174976,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: Conv_260 + Relu_261 (CudaDepthwiseConvolution) [02/13/2023-19:56:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: Conv_260 + Relu_261 (FusedConvActConvolution) [02/13/2023-19:56:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:31] [V] [TRT] --------------- Timing Runner: Conv_260 + Relu_261 (CudnnConvolution) [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.813467 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.667589 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000002 Time: 1.29044 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000005 Time: 3.29745 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.40379 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.817143 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.662885 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000003a Time: 1.3008 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000003d Time: 3.34288 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x000000000000003e Time: 0.403698 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.814693 [02/13/2023-19:56:31] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.672699 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x0000000000000072 Time: 1.29067 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x0000000000000075 Time: 3.32491 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.401234 [02/13/2023-19:56:32] [V] [TRT] Fastest Tactic: 0x0000000000000076 Time: 0.401234 [02/13/2023-19:56:32] [V] [TRT] --------------- Timing Runner: Conv_260 + Relu_261 (CaskConvolution) [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 1.74875 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 0.934501 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.883269 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x4727434768e46395 Time: 1.01675 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 1.65103 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 1.53938 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 1.67787 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 1.75055 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 0.850866 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 0.269289 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 1.01191 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.522587 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 1.66637 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 1.4016 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 1.57203 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.906139 [02/13/2023-19:56:32] [V] [TRT] Fastest Tactic: 0x94119b4c514b211a Time: 0.269289 [02/13/2023-19:56:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94119b4c514b211a [02/13/2023-19:56:32] [V] [TRT] *************** Autotuning format combination: Float(2174976,1,15104,59) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:56:32] [V] [TRT] --------------- Timing Runner: Conv_260 + Relu_261 (CaskConvolution) [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.992965 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.790656 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 3.0204 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 1.64098 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.858985 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.889842 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.846437 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 1.66799 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 1.53565 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 1.66262 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.788165 [02/13/2023-19:56:32] [V] [TRT] Fastest Tactic: 0xf48db81f02eca9ee Time: 0.788165 [02/13/2023-19:56:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:32] [V] [TRT] *************** Autotuning format combination: Float(552960,1:4,3840,15) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:56:32] [V] [TRT] --------------- Timing Runner: Conv_260 + Relu_261 (CaskConvolution) [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.641344 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.371067 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.985797 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.788155 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.376626 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.436187 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.938016 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.428754 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.445111 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.462057 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.514327 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.51211 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 3.02146 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.94571 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.714825 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 1.64036 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.685454 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.858144 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x634e99502974e4da Time: 1.61087 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.437074 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.603936 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.3424 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.354149 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.371214 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.338437 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 1.59968 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.886299 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.453024 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.845371 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.717129 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.419077 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.291872 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.426578 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.362894 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.302578 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 0.931634 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.363653 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 1.66731 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:32] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.299255 [02/13/2023-19:56:32] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 1.53551 [02/13/2023-19:56:33] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.581006 [02/13/2023-19:56:33] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.396846 [02/13/2023-19:56:33] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 1.66306 [02/13/2023-19:56:33] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.423881 [02/13/2023-19:56:33] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.402917 [02/13/2023-19:56:33] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.352795 [02/13/2023-19:56:33] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.608923 [02/13/2023-19:56:33] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.789179 [02/13/2023-19:56:33] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 1.60069 [02/13/2023-19:56:33] [V] [TRT] Fastest Tactic: 0xa9a06d0633580c0c Time: 0.291872 [02/13/2023-19:56:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:33] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:33] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:56:33] [V] [TRT] --------------- Timing Runner: Expand_264 (Slice) [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.02042 [02/13/2023-19:56:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.02042 [02/13/2023-19:56:33] [V] [TRT] --------------- Timing Runner: Expand_264 (Padding) [02/13/2023-19:56:33] [V] [TRT] Padding has no valid tactics for this config, skipping [02/13/2023-19:56:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [02/13/2023-19:56:33] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:33] [V] [TRT] *************** Autotuning format combination: Float(1179648,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:56:33] [V] [TRT] --------------- Timing Runner: Conv_266 (CudaDepthwiseConvolution) [02/13/2023-19:56:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:33] [V] [TRT] --------------- Timing Runner: Conv_266 (FusedConvActConvolution) [02/13/2023-19:56:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:33] [V] [TRT] --------------- Timing Runner: Conv_266 (CudnnConvolution) [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.445609 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.320338 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.728672 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x0000000000000005 Time: 2.00533 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.228987 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.445719 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.321001 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x000000000000003a Time: 0.722277 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x000000000000003d Time: 2.02964 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x000000000000003e Time: 0.229038 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.444946 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.360471 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.731031 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x0000000000000075 Time: 2.02273 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.227995 [02/13/2023-19:56:33] [V] [TRT] Fastest Tactic: 0x0000000000000076 Time: 0.227995 [02/13/2023-19:56:33] [V] [TRT] --------------- Timing Runner: Conv_266 (CaskConvolution) [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 1.01122 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 0.544037 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.489211 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x4727434768e46395 Time: 0.579877 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 0.95467 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.854889 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 0.970112 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 1.01513 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 0.478706 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 0.159762 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 0.580105 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.296526 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 0.968041 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 0.791186 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.867767 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.498098 [02/13/2023-19:56:33] [V] [TRT] Fastest Tactic: 0x94119b4c514b211a Time: 0.159762 [02/13/2023-19:56:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94119b4c514b211a [02/13/2023-19:56:33] [V] [TRT] *************** Autotuning format combination: Float(1179648,1,8192,32) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:56:33] [V] [TRT] --------------- Timing Runner: Conv_266 (CaskConvolution) [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.168645 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.366359 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.200389 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.529874 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.173184 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.343058 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.434679 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.220814 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.470437 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.264585 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.487767 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.352375 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.251159 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.388613 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.139698 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.2752 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.270944 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 1.69589 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.249408 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.170226 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.492581 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.452791 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.252969 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.410921 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.843419 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.303502 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.403205 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.465888 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x634e99502974e4da Time: 0.82885 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.238693 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.344594 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.193358 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.280782 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.296475 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.138462 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.188142 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.821925 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.192229 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.306505 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.489568 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.381641 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.226569 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.217733 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.460398 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.164759 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.421751 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.217376 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.134341 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.152142 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.279182 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.163662 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.137698 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.450085 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.225787 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.301449 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.148635 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.160434 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 0.486121 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.300219 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.85744 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.178409 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.158167 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.459634 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.828741 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.328823 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.320942 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:33] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.853897 [02/13/2023-19:56:33] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.257358 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.188389 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.231246 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.275264 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.287867 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.316805 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.335131 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.431954 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.203264 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.821755 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.14619 [02/13/2023-19:56:34] [V] [TRT] Fastest Tactic: 0x9cb304e2edbc1221 Time: 0.134341 [02/13/2023-19:56:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:56:34] [V] [TRT] *************** Autotuning format combination: Float(294912,1:4,2048,8) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:56:34] [V] [TRT] --------------- Timing Runner: Conv_266 (CaskConvolution) [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.167849 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.366304 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.200882 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.173029 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.341783 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.220983 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.47013 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.264421 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.352512 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.251287 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.389426 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.139257 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.249637 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.170213 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.451122 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.252146 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.410839 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.303429 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.403657 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.239771 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.344631 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.193518 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.281001 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.297659 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.139086 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.187666 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.193326 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.305934 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.381925 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.225742 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.217495 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.165861 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.423465 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.217129 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.135657 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.153102 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.279447 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.163986 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.136626 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.448878 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.223845 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.302112 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.150208 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.161458 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.299968 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.178583 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.158135 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.45957 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.32976 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.321317 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.258043 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.187959 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.232201 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.274373 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.288265 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.317742 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.335744 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.202606 [02/13/2023-19:56:34] [V] [TRT] Conv_266 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:56:34] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.147122 [02/13/2023-19:56:34] [V] [TRT] Fastest Tactic: 0x9cb304e2edbc1221 Time: 0.135657 [02/13/2023-19:56:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:56:34] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:34] [V] [TRT] *************** Autotuning format combination: Float(1179648,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:56:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_267) (PointWiseV2) [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0699733 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0620328 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0563139 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0594194 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0562088 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0552869 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0597211 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0569844 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0565455 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0565714 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0699672 [02/13/2023-19:56:34] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.0552869 [02/13/2023-19:56:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_267) (PointWise) [02/13/2023-19:56:34] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:56:34] [V] [TRT] *************** Autotuning format combination: Float(1179648,1,8192,32) -> Float(1179648,1,8192,32) *************** [02/13/2023-19:56:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_267) (PointWiseV2) [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0703512 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0611017 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0558491 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0593448 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0561219 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.055645 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0593143 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0566766 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0563627 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0561173 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0698682 [02/13/2023-19:56:34] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.055645 [02/13/2023-19:56:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_267) (PointWise) [02/13/2023-19:56:34] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [02/13/2023-19:56:34] [V] [TRT] *************** Autotuning format combination: Float(294912,1:4,2048,8) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:56:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_267) (PointWiseV2) [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0585432 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0594453 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0719109 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.061021 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0719863 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0829829 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0611703 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0710796 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0828891 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.089168 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0565288 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0566903 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0585387 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0574202 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0595977 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0718926 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0576518 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.061085 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0725897 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.084192 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0719154 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0632274 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0604968 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.059267 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0587642 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0564891 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000001e Time: 0.071456 [02/13/2023-19:56:34] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.0564891 [02/13/2023-19:56:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_267) (PointWise) [02/13/2023-19:56:34] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [02/13/2023-19:56:34] [V] [TRT] *************** Autotuning format combination: Float(36864,36864:32,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:56:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_267) (PointWiseV2) [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0589516 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0598644 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0609935 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0614827 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0587337 [02/13/2023-19:56:34] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0587337 [02/13/2023-19:56:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_267) (PointWise) [02/13/2023-19:56:34] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [02/13/2023-19:56:34] [V] [TRT] *************** Autotuning format combination: Float(1:4,36864,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:56:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_267) (PointWiseV2) [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.38398 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 2.80688 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000002 Time: 3.17003 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000003 Time: 3.28195 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 4.20201 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 3.21096 [02/13/2023-19:56:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 4.23843 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000007 Time: 5.5341 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000008 Time: 5.24443 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000009 Time: 4.24067 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000000000a Time: 2.26474 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000000000b Time: 3.07243 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000000000c Time: 2.63768 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000000000d Time: 4.23323 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000000000e Time: 3.46499 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000000000f Time: 2.70987 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000010 Time: 6.62547 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000011 Time: 4.59526 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000012 Time: 3.91564 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000013 Time: 3.17141 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000014 Time: 1.99999 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000015 Time: 2.65711 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000016 Time: 3.64987 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000017 Time: 5.70553 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000000001c Time: 0.243758 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000000001d Time: 0.250894 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000000001e Time: 0.279159 [02/13/2023-19:56:35] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.243758 [02/13/2023-19:56:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:56:35] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:35] [V] [TRT] *************** Autotuning format combination: Float(1179648,36864,256,1), Float(1179648,36864,256,1) -> Float(1179648,36864,256,1) *************** [02/13/2023-19:56:35] [V] [TRT] --------------- Timing Runner: Mul_269 (ElementWise) [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0441737 [02/13/2023-19:56:35] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0441737 [02/13/2023-19:56:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:56:35] [V] [TRT] *************** Autotuning format combination: Float(294912,1:4,2048,8), Float(294912,1:4,2048,8) -> Float(294912,1:4,2048,8) *************** [02/13/2023-19:56:35] [V] [TRT] --------------- Timing Runner: Mul_269 (ElementWise) [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.04456 [02/13/2023-19:56:35] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.04456 [02/13/2023-19:56:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:56:35] [V] [TRT] *************** Autotuning format combination: Float(36864,36864:32,256,1), Float(36864,36864:32,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:56:35] [V] [TRT] --------------- Timing Runner: Mul_269 (ElementWise) [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0822926 [02/13/2023-19:56:35] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0822926 [02/13/2023-19:56:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:56:35] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:35] [V] [TRT] *************** Autotuning format combination: Float(1179648,36864,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:56:35] [V] [TRT] --------------- Timing Runner: Conv_271 (CudaDepthwiseConvolution) [02/13/2023-19:56:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:35] [V] [TRT] --------------- Timing Runner: Conv_271 (FusedConvActConvolution) [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000007ffff Time: 0.329833 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x00000000000affff Time: 0.446633 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x00000000000effff Time: 0.488402 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x00000000000fffff Time: 0.266382 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x00000000001effff Time: 0.458126 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000027ffff Time: 0.288768 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000034ffff Time: 0.956046 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000038ffff Time: 0.831753 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000062ffff Time: 0.256283 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x00000000006effff Time: 0.598514 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000086ffff Time: 0.454971 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x000000000089ffff Time: 0.264174 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x00000000009fffff Time: 0.264005 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000a2ffff Time: 0.279593 [02/13/2023-19:56:35] [V] [TRT] Fastest Tactic: 0x000000000062ffff Time: 0.256283 [02/13/2023-19:56:35] [V] [TRT] --------------- Timing Runner: Conv_271 (CudnnConvolution) [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.40123 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.24203 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.653637 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.948768 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.195008 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.404786 [02/13/2023-19:56:35] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.243593 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x000000000000003a Time: 0.650528 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x000000000000003d Time: 0.950263 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x000000000000003e Time: 0.193998 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.401394 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.326181 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.647369 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.948087 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.194185 [02/13/2023-19:56:36] [V] [TRT] Fastest Tactic: 0x000000000000003e Time: 0.193998 [02/13/2023-19:56:36] [V] [TRT] --------------- Timing Runner: Conv_271 (CaskConvolution) [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 1.01095 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 0.544014 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.488722 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x4727434768e46395 Time: 0.579584 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 0.953147 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.855511 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 0.969275 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 1.01447 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 0.477207 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 0.158217 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 0.579968 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.29499 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 0.966871 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 0.790162 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.867255 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.498263 [02/13/2023-19:56:36] [V] [TRT] Fastest Tactic: 0x94119b4c514b211a Time: 0.158217 [02/13/2023-19:56:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94119b4c514b211a [02/13/2023-19:56:36] [V] [TRT] *************** Autotuning format combination: Float(1179648,1,8192,32) -> Float(589824,1,4096,16) *************** [02/13/2023-19:56:36] [V] [TRT] --------------- Timing Runner: Conv_271 (CaskConvolution) [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.0938834 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.36688 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.198642 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 0.528786 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.09384 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.288581 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.43307 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.218971 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.246007 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.262875 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.48779 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.353088 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.248384 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.389691 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.127278 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.273961 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.270949 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 1.69712 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.143465 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.0949211 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.492544 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.234144 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.142126 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.40571 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.843378 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.246683 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.400759 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 0.465591 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x634e99502974e4da Time: 0.82757 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.236544 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.345833 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.19264 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.283561 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.299959 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.120878 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.187593 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.820832 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.158587 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.247227 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.484416 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.382048 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.192782 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.18976 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 0.45909 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.0933531 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.41877 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.216841 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.11995 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.150327 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.146469 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.0939109 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.126341 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.234011 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.222277 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.299776 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.12781 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.158345 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 0.485737 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.297911 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 0.856059 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.0945897 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.155899 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.233047 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 0.827241 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.329166 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.323479 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.852763 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.254743 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.156027 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.229074 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.147182 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.287154 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.248475 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.332974 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.430793 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.160096 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.820594 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.120128 [02/13/2023-19:56:36] [V] [TRT] Fastest Tactic: 0x96467934a22da27d Time: 0.0933531 [02/13/2023-19:56:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x96467934a22da27d [02/13/2023-19:56:36] [V] [TRT] *************** Autotuning format combination: Float(294912,1:4,2048,8) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:56:36] [V] [TRT] --------------- Timing Runner: Conv_271 (CaskConvolution) [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.0930789 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 0.366555 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.198752 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.0945326 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.287451 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.219241 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.245591 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 0.262688 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 0.351808 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.248754 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 0.390213 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.126482 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.14221 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.0942126 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.233961 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.142917 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 0.40507 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.246917 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 0.400754 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.235355 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 0.345957 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.192416 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 0.28325 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 0.299977 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.120789 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.187401 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.157792 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.247365 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 0.381463 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.193303 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.189979 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.0934194 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 0.418647 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.215511 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.120434 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.150039 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.146629 [02/13/2023-19:56:36] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:56:36] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.0930971 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.126667 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.233193 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.222478 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 0.300878 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.128432 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.158176 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 0.298258 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.0956503 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.157147 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.233161 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 0.329559 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 0.324745 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.255877 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.157038 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.229481 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.148256 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 0.287433 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.250098 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 0.334583 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.161947 [02/13/2023-19:56:37] [V] [TRT] Conv_271 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:56:37] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.121431 [02/13/2023-19:56:37] [V] [TRT] Fastest Tactic: 0x10383a0781d24dde Time: 0.0930789 [02/13/2023-19:56:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x10383a0781d24dde [02/13/2023-19:56:37] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:37] [V] [TRT] *************** Autotuning format combination: Float(589824,36864,256,1), Float(1179648,36864,256,1), Float(1179648,36864,256,1) -> Float(589824,36864,256,1) *************** [02/13/2023-19:56:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_272), Mul_276), PWN(PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275), Add_277)) (PointWiseV2) [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0562804 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0551497 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0553234 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0559924 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0550781 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0552777 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0557867 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.054845 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0556008 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0558705 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0561676 [02/13/2023-19:56:37] [V] [TRT] Fastest Tactic: 0x0000000000000007 Time: 0.054845 [02/13/2023-19:56:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_272), Mul_276), PWN(PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275), Add_277)) (PointWise) [02/13/2023-19:56:37] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000007 [02/13/2023-19:56:37] [V] [TRT] *************** Autotuning format combination: Float(589824,1,4096,16), Float(1179648,1,8192,32), Float(1179648,1,8192,32) -> Float(589824,1,4096,16) *************** [02/13/2023-19:56:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_272), Mul_276), PWN(PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275), Add_277)) (PointWiseV2) [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0772206 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0904366 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0827977 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.109159 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.12189 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0942149 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.151671 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.177271 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.154199 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.135314 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0559086 [02/13/2023-19:56:37] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0559086 [02/13/2023-19:56:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_272), Mul_276), PWN(PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275), Add_277)) (PointWise) [02/13/2023-19:56:37] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:56:37] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,1024,4), Float(294912,1:4,2048,8), Float(294912,1:4,2048,8) -> Float(147456,1:4,1024,4) *************** [02/13/2023-19:56:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_272), Mul_276), PWN(PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275), Add_277)) (PointWiseV2) [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.1336 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.13928 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.148398 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.152928 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.19003 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.158519 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.188777 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.226546 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.23963 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.320055 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0928731 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000000b Time: 0.121712 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000000c Time: 0.100608 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000000d Time: 0.15995 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000000e Time: 0.134126 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000000f Time: 0.103483 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.237838 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.169513 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.164347 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.154446 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.083072 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.100946 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.119698 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.160663 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0833097 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0656259 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0570743 [02/13/2023-19:56:37] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.0570743 [02/13/2023-19:56:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_272), Mul_276), PWN(PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275), Add_277)) (PointWise) [02/13/2023-19:56:37] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [02/13/2023-19:56:37] [V] [TRT] *************** Autotuning format combination: Float(36864,36864:32,256,1), Float(36864,36864:32,256,1), Float(36864,36864:32,256,1) -> Float(36864,36864:32,256,1) *************** [02/13/2023-19:56:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_272), Mul_276), PWN(PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275), Add_277)) (PointWiseV2) [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.157586 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.151799 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000001a Time: 0.149655 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000001b Time: 0.147383 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000001f Time: 0.156827 [02/13/2023-19:56:37] [V] [TRT] Fastest Tactic: 0x000000000000001b Time: 0.147383 [02/13/2023-19:56:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_272), Mul_276), PWN(PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275), Add_277)) (PointWise) [02/13/2023-19:56:37] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001b [02/13/2023-19:56:37] [V] [TRT] *************** Autotuning format combination: Float(1:4,36864,256,1), Float(1:4,36864,256,1), Float(1:4,36864,256,1) -> Float(1:4,36864,256,1) *************** [02/13/2023-19:56:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Tanh_272), Mul_276), PWN(PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275), Add_277)) (PointWiseV2) [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.7449 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 2.4127 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 2.32814 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 2.86918 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 3.04383 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000005 Time: 2.40869 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000006 Time: 3.76523 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000007 Time: 3.6911 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000008 Time: 3.83492 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x0000000000000009 Time: 4.95103 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000000a Time: 1.38434 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000000b Time: 1.85351 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000000c Time: 1.56045 [02/13/2023-19:56:37] [V] [TRT] Tactic: 0x000000000000000d Time: 2.33543 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x000000000000000e Time: 2.26242 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x000000000000000f Time: 1.59277 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000010 Time: 3.31872 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000011 Time: 3.08476 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000012 Time: 2.63214 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000013 Time: 2.12475 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000014 Time: 1.20572 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000015 Time: 1.61321 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000016 Time: 2.00052 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000017 Time: 2.79334 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x000000000000001c Time: 0.309298 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x000000000000001d Time: 0.236101 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x000000000000001e Time: 0.205938 [02/13/2023-19:56:38] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.205938 [02/13/2023-19:56:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [02/13/2023-19:56:38] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:38] [V] [TRT] *************** Autotuning format combination: Float(1179648,36864,256,1) -> Float(4718592,147456,512,1) *************** [02/13/2023-19:56:38] [V] [TRT] --------------- Timing Runner: Resize_280 (Resize) [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.293847 [02/13/2023-19:56:38] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.293847 [02/13/2023-19:56:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 [02/13/2023-19:56:38] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:38] [V] [TRT] *************** Autotuning format combination: Float(5160960,147456,512,1) -> Float(2359296,147456,512,1) *************** [02/13/2023-19:56:38] [V] [TRT] --------------- Timing Runner: Conv_290 + Relu_291 (CudaDepthwiseConvolution) [02/13/2023-19:56:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:38] [V] [TRT] --------------- Timing Runner: Conv_290 + Relu_291 (FusedConvActConvolution) [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x000000000007ffff Time: 1.15685 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x00000000001effff Time: 1.88713 [02/13/2023-19:56:38] [V] [TRT] Fastest Tactic: 0x000000000007ffff Time: 1.15685 [02/13/2023-19:56:38] [V] [TRT] --------------- Timing Runner: Conv_290 + Relu_291 (CudnnConvolution) [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.84548 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000001 Time: 1.43953 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000002 Time: 2.80881 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000005 Time: 4.14043 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.966949 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000038 Time: 1.84885 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000039 Time: 1.42847 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x000000000000003a Time: 2.82173 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x000000000000003d Time: 4.13322 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x000000000000003e Time: 0.980037 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000070 Time: 1.8425 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000071 Time: 1.44635 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000072 Time: 2.80503 [02/13/2023-19:56:38] [V] [TRT] Tactic: 0x0000000000000075 Time: 4.15064 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.966107 [02/13/2023-19:56:39] [V] [TRT] Fastest Tactic: 0x0000000000000076 Time: 0.966107 [02/13/2023-19:56:39] [V] [TRT] --------------- Timing Runner: Conv_290 + Relu_291 (CaskConvolution) [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 4.4027 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 2.35254 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 2.10539 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x4727434768e46395 Time: 2.51431 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 4.13916 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 3.739 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 4.22304 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 4.41259 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 2.03068 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 0.715835 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:56:39] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 2.52271 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 1.17386 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 4.16744 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 3.42637 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:56:39] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 3.79225 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 2.14116 [02/13/2023-19:56:39] [V] [TRT] Fastest Tactic: 0x94119b4c514b211a Time: 0.715835 [02/13/2023-19:56:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94119b4c514b211a [02/13/2023-19:56:39] [V] [TRT] *************** Autotuning format combination: Float(5160960,1,17920,35) -> Float(2359296,1,8192,16) *************** [02/13/2023-19:56:39] [V] [TRT] --------------- Timing Runner: Conv_290 + Relu_291 (CaskConvolution) [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 2.52587 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 2.03322 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 7.96781 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 4.1323 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 2.21188 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 2.02048 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 2.17168 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:39] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 4.20354 [02/13/2023-19:56:39] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 3.98276 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 4.21126 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:40] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 2.0341 [02/13/2023-19:56:40] [V] [TRT] Fastest Tactic: 0x8014228ec08b4d49 Time: 2.02048 [02/13/2023-19:56:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:40] [V] [TRT] *************** Autotuning format combination: Float(1327104,1:4,4608,9) -> Float(589824,1:4,2048,4) *************** [02/13/2023-19:56:40] [V] [TRT] --------------- Timing Runner: Conv_290 + Relu_291 (CaskConvolution) [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 2.42473 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 1.36148 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 2.52059 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 2.0295 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 1.40089 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 1.62808 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 2.82433 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 1.48897 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 1.66164 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 1.67062 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 1.99602 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 1.98235 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 7.99315 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 2.8672 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 2.75895 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 4.15338 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 2.63991 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 2.21056 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x634e99502974e4da Time: 4.05231 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 1.32349 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 2.26744 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 1.22203 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 1.17135 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 1.24469 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 1.19939 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 4.01964 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:40] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 2.0277 [02/13/2023-19:56:40] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 1.58421 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 2.16653 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 2.75453 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 1.18481 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.976553 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 1.2199 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 1.24223 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 1.06564 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 2.79328 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 1.21621 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 4.20118 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 1.02956 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 3.98894 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 2.18202 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 1.40375 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 4.18499 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 1.57345 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 1.49261 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 1.16739 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 2.35318 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 2.02769 [02/13/2023-19:56:41] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 4.02223 [02/13/2023-19:56:41] [V] [TRT] Fastest Tactic: 0xa9a06d0633580c0c Time: 0.976553 [02/13/2023-19:56:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:41] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:41] [V] [TRT] *************** Autotuning format combination: Float(2359296,147456,512,1) -> Float(3538944,147456,512,1) *************** [02/13/2023-19:56:41] [V] [TRT] --------------- Timing Runner: Conv_292 + Relu_293 (CudaDepthwiseConvolution) [02/13/2023-19:56:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:41] [V] [TRT] --------------- Timing Runner: Conv_292 + Relu_293 (FusedConvActConvolution) [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x000000000007ffff Time: 0.70939 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x00000000000affff Time: 0.978432 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x00000000000effff Time: 1.12548 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x00000000000fffff Time: 0.611607 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x00000000001effff Time: 0.958373 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x000000000027ffff Time: 0.708567 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x000000000034ffff Time: 2.02788 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x000000000038ffff Time: 1.75236 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x000000000062ffff Time: 0.599557 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x00000000006effff Time: 1.43899 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x000000000086ffff Time: 1.1967 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x000000000089ffff Time: 0.642469 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x00000000009fffff Time: 0.647579 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x0000000000a2ffff Time: 0.702569 [02/13/2023-19:56:41] [V] [TRT] Fastest Tactic: 0x000000000062ffff Time: 0.599557 [02/13/2023-19:56:41] [V] [TRT] --------------- Timing Runner: Conv_292 + Relu_293 (CudnnConvolution) [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.00046 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.651237 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x0000000000000002 Time: 1.44842 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x0000000000000005 Time: 3.78361 [02/13/2023-19:56:41] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.647205 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x0000000000000038 Time: 1.00081 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.652219 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x000000000000003a Time: 1.57104 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x000000000000003d Time: 3.77623 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x000000000000003e Time: 0.674016 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.999698 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.856718 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x0000000000000072 Time: 1.45113 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x0000000000000075 Time: 3.78254 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x0000000000000076 Time: 0.677303 [02/13/2023-19:56:42] [V] [TRT] Fastest Tactic: 0x0000000000000006 Time: 0.647205 [02/13/2023-19:56:42] [V] [TRT] --------------- Timing Runner: Conv_292 + Relu_293 (CaskConvolution) [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x01cf8ce2da913006 Time: 2.3229 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x12dbf7d94ee3696d Time: 1.24227 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.994341 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x4727434768e46395 Time: 1.28075 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x4efce38acc876f5c Time: 2.1668 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 1.79546 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x5403ad713f811a18 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x5403ad713f811a18 Time: 2.21777 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x5aa723e0481da855 Time: 2.32566 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x5deb29b7a8e275f7 Time: 0.990496 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x94119b4c514b211a Time: 0.396279 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff [02/13/2023-19:56:42] [V] [TRT] Tactic: 0xa31d27de74b895ff Time: 1.28912 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.573088 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0xbb8c3889c7eacd30 Time: 2.19708 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0xd828f024626fa982 Time: 1.70875 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:56:42] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 1.81935 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 1.01556 [02/13/2023-19:56:42] [V] [TRT] Fastest Tactic: 0x94119b4c514b211a Time: 0.396279 [02/13/2023-19:56:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94119b4c514b211a [02/13/2023-19:56:42] [V] [TRT] *************** Autotuning format combination: Float(2359296,1,8192,16) -> Float(3538944,1,12288,24) *************** [02/13/2023-19:56:42] [V] [TRT] --------------- Timing Runner: Conv_292 + Relu_293 (CaskConvolution) [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 1.46788 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.798761 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x19b688348f983aa0 Time: 1.14987 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x1da91d865428f237 Time: 0.976379 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.833696 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 1.00617 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 1.01103 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 1.43431 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.950693 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 1.59412 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 1.0792 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 1.07226 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x3f0c846d6379bc98 Time: 4.00202 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 1.02154 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 1.59104 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 1.72818 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 1.57026 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x62835fce994f06dd Time: 1.04142 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x634e99502974e4da [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x634e99502974e4da Time: 1.70573 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:42] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.562441 [02/13/2023-19:56:42] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 1.37654 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.754514 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 1.1585 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 1.23115 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.725225 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 1.67557 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x8014228ec08b4d49 Time: 0.994638 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 1.53744 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x94a7db94ba744c45 Time: 1.00813 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 1.63098 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.517888 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.581394 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.535781 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 1.20598 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.61477 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xbdfdef6b84f7ccc9 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xbdfdef6b84f7ccc9 Time: 1.00959 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 1.17527 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca7eeb8d9143d738 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xca7eeb8d9143d738 Time: 1.76274 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.608466 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xd15dd11d64344e83 Time: 1.86053 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 1.3055 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 1.35074 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 1.75283 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.973413 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.881774 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 1.1316 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 1.35328 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xf48db81f02eca9ee Time: 0.961449 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 1.68382 [02/13/2023-19:56:43] [V] [TRT] Fastest Tactic: 0x999e005e3b016ea6 Time: 0.517888 [02/13/2023-19:56:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:43] [V] [TRT] *************** Autotuning format combination: Float(589824,1:4,2048,4) -> Float(884736,1:4,3072,6) *************** [02/13/2023-19:56:43] [V] [TRT] --------------- Timing Runner: Conv_292 + Relu_293 (CaskConvolution) [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x112d7e4d280f396d [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x112d7e4d280f396d Time: 1.47069 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x13cc2ad8dcd32ba2 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x13cc2ad8dcd32ba2 Time: 0.800219 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x21246c8544eff903 Time: 0.834775 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x25b2b9d5c9d5ca0d [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x25b2b9d5c9d5ca0d Time: 1.0083 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x2d80d2b384ab13f1 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x2d80d2b384ab13f1 Time: 1.43806 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x36303f399d3ee4fd [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x36303f399d3ee4fd Time: 0.952494 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x385bfab9332b1413 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x385bfab9332b1413 Time: 1.59789 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x482b48242255b8ce [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x482b48242255b8ce Time: 1.58957 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x614e89f7852edbc3 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x614e89f7852edbc3 Time: 1.5627 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x65e41d81f093b482 Time: 0.560046 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65f71607d20d5438 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x65f71607d20d5438 Time: 1.37703 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6716429226d146f7 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x6716429226d146f7 Time: 0.754363 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x679a281f7660c436 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x679a281f7660c436 Time: 1.15831 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6e2a3c7a7fc5e4e1 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x6e2a3c7a7fc5e4e1 Time: 1.23213 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x7aa21282feb15f1a [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x7aa21282feb15f1a Time: 0.725504 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x818413b69874bb35 Time: 1.53675 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0x998c97842e775a17 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x998c97842e775a17 Time: 1.63076 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0x999e005e3b016ea6 Time: 0.517371 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xa9a06d0633580c0c Time: 0.580809 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xb443c221fcb1565b Time: 0.535182 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb47d7d926de02dee [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xb47d7d926de02dee Time: 1.20679 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xba0185279ccb2b85 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xba0185279ccb2b85 Time: 0.613838 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xc0a715d897e240bb [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xc0a715d897e240bb Time: 1.1761 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xcedbed6d66c946d0 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xcedbed6d66c946d0 Time: 0.609655 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xd4428a7355769d7d Time: 1.30951 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd7f5d575d49a4bc7 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xd7f5d575d49a4bc7 Time: 1.35689 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd920b33c9bd27143 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xd920b33c9bd27143 Time: 0.978816 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0xe797e099911c0624 [02/13/2023-19:56:43] [V] [TRT] Tactic: 0xe797e099911c0624 Time: 0.882807 [02/13/2023-19:56:43] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xeb65d4c1e8fa2294 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0xeb65d4c1e8fa2294 Time: 1.12921 [02/13/2023-19:56:44] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xf4156675c5f728d4 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0xf4156675c5f728d4 Time: 1.3506 [02/13/2023-19:56:44] [V] [TRT] Fastest Tactic: 0x999e005e3b016ea6 Time: 0.517371 [02/13/2023-19:56:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x999e005e3b016ea6 [02/13/2023-19:56:44] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:44] [V] [TRT] *************** Autotuning format combination: Float(3538944,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:56:44] [V] [TRT] --------------- Timing Runner: Conv_294 (CudaDepthwiseConvolution) [02/13/2023-19:56:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:44] [V] [TRT] --------------- Timing Runner: Conv_294 (FusedConvActConvolution) [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.389518 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.555013 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.232549 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000000cffff Time: 1.01992 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000011ffff Time: 0.526857 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.324699 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.409705 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.518994 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000003cffff Time: 0.28245 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.221253 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000045ffff Time: 0.235013 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000046ffff Time: 0.567145 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000004affff Time: 0.302359 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.203438 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000004effff Time: 0.528416 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.305381 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000051ffff Time: 0.560645 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.715045 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000057ffff Time: 0.827209 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000059ffff Time: 0.567749 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000005effff Time: 0.355447 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000005fffff Time: 0.527909 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.347758 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.351319 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.414962 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.31845 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000006fffff Time: 0.580018 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.613134 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.398203 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.264622 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.407918 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000091ffff Time: 0.302866 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x00000000009dffff Time: 0.306789 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.390862 [02/13/2023-19:56:44] [V] [TRT] Fastest Tactic: 0x00000000004bffff Time: 0.203438 [02/13/2023-19:56:44] [V] [TRT] --------------- Timing Runner: Conv_294 (CudnnConvolution) [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.166254 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.111865 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.278674 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.368677 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.1656 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.113152 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000000003a Time: 0.281106 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x000000000000003d Time: 0.370994 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.165051 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.178853 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.281335 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.372709 [02/13/2023-19:56:44] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.111865 [02/13/2023-19:56:44] [V] [TRT] --------------- Timing Runner: Conv_294 (CublasConvolution) [02/13/2023-19:56:44] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:44] [V] [TRT] --------------- Timing Runner: Conv_294 (CaskConvolution) [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 1.30417 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.700869 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 1.51235 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.659808 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.249326 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 1.15541 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.515255 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.720869 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.485211 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 1.15042 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.547982 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.374286 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.145111 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.150066 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.511127 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:56:44] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.786075 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.242912 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 1.17688 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.42107 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.9488 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:56:44] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.517605 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.252645 [02/13/2023-19:56:44] [V] [TRT] Fastest Tactic: 0x9808072e706def96 Time: 0.145111 [02/13/2023-19:56:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000001 [02/13/2023-19:56:44] [V] [TRT] *************** Autotuning format combination: Float(3538944,1,12288,24) -> Float(589824,1,2048,4) *************** [02/13/2023-19:56:44] [V] [TRT] --------------- Timing Runner: Conv_294 (CublasConvolution) [02/13/2023-19:56:44] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:44] [V] [TRT] --------------- Timing Runner: Conv_294 (CaskConvolution) [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.599095 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.0890011 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.251593 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.391945 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.0819246 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.202043 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.135509 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.244882 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.32123 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.314318 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.125243 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.325371 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.323474 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.0963177 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.0887909 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.321541 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.0960823 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.0954491 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.395845 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.437033 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.315547 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.0951109 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.56395 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.389815 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.0835886 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.391954 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.0956366 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.0960023 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.179067 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:56:44] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.174958 [02/13/2023-19:56:44] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.082528 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.0826149 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.516416 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.107977 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.345093 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.314107 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.0822034 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.123013 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.0966126 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.128825 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.319813 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.0899749 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.0963177 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.398135 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.095456 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.388672 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.143817 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.626857 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.445239 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.333147 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.0965577 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.095376 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.392224 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.0831154 [02/13/2023-19:56:45] [V] [TRT] Fastest Tactic: 0x1a373db9a2bc4028 Time: 0.0819246 [02/13/2023-19:56:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:56:45] [V] [TRT] *************** Autotuning format combination: Float(884736,1:4,3072,6) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:56:45] [V] [TRT] --------------- Timing Runner: Conv_294 (CublasConvolution) [02/13/2023-19:56:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:45] [V] [TRT] --------------- Timing Runner: Conv_294 (CaskConvolution) [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.0878034 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.251433 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.0824937 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.201938 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.135845 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.246075 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.125077 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.0956046 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.0897326 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.0956023 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.0950811 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.436005 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.095616 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.562523 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.391342 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.0828137 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.0952389 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.0959086 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.180581 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.17579 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.0823406 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.0832594 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.515904 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.107431 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.344507 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.0824114 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.123435 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.0957303 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.129104 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.0898263 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.0956777 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.0955429 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.144014 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.620485 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.445211 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.333111 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.0964137 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.0956503 [02/13/2023-19:56:45] [V] [TRT] Conv_294 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:56:45] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.0833874 [02/13/2023-19:56:45] [V] [TRT] Fastest Tactic: 0x96467934a22da27d Time: 0.0823406 [02/13/2023-19:56:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x96467934a22da27d [02/13/2023-19:56:45] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:45] [V] [TRT] *************** Autotuning format combination: Float(589824,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:56:45] [V] [TRT] *************** Autotuning format combination: Float(589824,1,2048,4) -> Float(589824,1,2048,4) *************** [02/13/2023-19:56:45] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:56:45] [V] [TRT] --------------- Timing Runner: Conv_302 (CaskConvolution) [02/13/2023-19:56:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:45] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:45] [V] [TRT] *************** Autotuning format combination: Float(589824,147456,512,1), Float(589824,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:56:45] [V] [TRT] --------------- Timing Runner: Mul_303 (ElementWise) [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0442377 [02/13/2023-19:56:45] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0442377 [02/13/2023-19:56:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:56:45] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,512,1), Float(147456,1:4,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:56:45] [V] [TRT] --------------- Timing Runner: Mul_303 (ElementWise) [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0440686 [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0750971 [02/13/2023-19:56:45] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0440686 [02/13/2023-19:56:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:56:45] [V] [TRT] *************** Autotuning format combination: Float(147456,147456:32,512,1), Float(147456,147456:32,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:56:45] [V] [TRT] --------------- Timing Runner: Mul_303 (ElementWise) [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.371653 [02/13/2023-19:56:45] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.371653 [02/13/2023-19:56:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [02/13/2023-19:56:45] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:45] [V] [TRT] *************** Autotuning format combination: Float(589824,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:56:45] [V] [TRT] *************** Autotuning format combination: Float(589824,1,2048,4) -> Float(589824,1,2048,4) *************** [02/13/2023-19:56:45] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:56:45] [V] [TRT] --------------- Timing Runner: Conv_304 (CaskConvolution) [02/13/2023-19:56:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/13/2023-19:56:45] [V] [TRT] =============== Computing costs for [02/13/2023-19:56:45] [V] [TRT] *************** Autotuning format combination: Float(589824,147456,512,1), Float(589824,147456,512,1), Float(589824,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:56:45] [V] [TRT] --------------- Timing Runner: PWN(Mul_305, Sub_306) (PointWiseV2) [02/13/2023-19:56:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0556632 [02/13/2023-19:56:46] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.055901 [02/13/2023-19:56:46] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0557638 [02/13/2023-19:56:46] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0557135 [02/13/2023-19:56:47] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0549455 [02/13/2023-19:56:47] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0559528 [02/13/2023-19:56:47] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0564404 [02/13/2023-19:56:47] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0550766 [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.055453 [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0551817 [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0560716 [02/13/2023-19:56:48] [V] [TRT] Fastest Tactic: 0x0000000000000004 Time: 0.0549455 [02/13/2023-19:56:48] [V] [TRT] --------------- Timing Runner: PWN(Mul_305, Sub_306) (PointWise) [02/13/2023-19:56:48] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000004 [02/13/2023-19:56:48] [V] [TRT] *************** Autotuning format combination: Float(589824,1,2048,4), Float(589824,1,2048,4), Float(589824,1,2048,4) -> Float(589824,1,2048,4) *************** [02/13/2023-19:56:48] [V] [TRT] --------------- Timing Runner: PWN(Mul_305, Sub_306) (PointWiseV2) [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0564145 [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0554514 [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0556236 [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0560076 [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0550263 [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0558187 [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.056352 [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0560579 [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0555276 [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0558735 [02/13/2023-19:56:48] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0551238 [02/13/2023-19:56:48] [V] [TRT] Fastest Tactic: 0x0000000000000004 Time: 0.0550263 [02/13/2023-19:56:48] [V] [TRT] --------------- Timing Runner: PWN(Mul_305, Sub_306) (PointWise) [02/13/2023-19:56:48] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000004 [02/13/2023-19:56:48] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,512,1), Float(147456,1:4,512,1), Float(147456,1:4,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:56:48] [V] [TRT] --------------- Timing Runner: PWN(Mul_305, Sub_306) (PointWiseV2) [02/13/2023-19:56:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0797806 [02/13/2023-19:56:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0771246 [02/13/2023-19:56:49] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0973966 [02/13/2023-19:56:50] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0744891 [02/13/2023-19:56:50] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0932594 [02/13/2023-19:56:50] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.107842 [02/13/2023-19:56:51] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0709135 [02/13/2023-19:56:51] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0929966 [02/13/2023-19:56:51] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0989417 [02/13/2023-19:56:52] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.11021 [02/13/2023-19:56:52] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0631299 [02/13/2023-19:56:52] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0626926 [02/13/2023-19:56:53] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0796937 [02/13/2023-19:56:53] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0628312 [02/13/2023-19:56:53] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0725006 [02/13/2023-19:56:54] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0973577 [02/13/2023-19:56:54] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0635794 [02/13/2023-19:56:54] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0727794 [02/13/2023-19:56:55] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.085712 [02/13/2023-19:56:55] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.104711 [02/13/2023-19:56:55] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0561996 [02/13/2023-19:56:56] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.055485 [02/13/2023-19:56:56] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0559269 [02/13/2023-19:56:56] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0568335 [02/13/2023-19:56:56] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0802354 [02/13/2023-19:56:57] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0626133 [02/13/2023-19:56:57] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0560107 [02/13/2023-19:56:57] [V] [TRT] Fastest Tactic: 0x0000000000000015 Time: 0.055485 [02/13/2023-19:56:57] [V] [TRT] --------------- Timing Runner: PWN(Mul_305, Sub_306) (PointWise) [02/13/2023-19:56:57] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000015 [02/13/2023-19:56:57] [V] [TRT] *************** Autotuning format combination: Float(147456,147456:32,512,1), Float(147456,147456:32,512,1), Float(147456,147456:32,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:56:57] [V] [TRT] --------------- Timing Runner: PWN(Mul_305, Sub_306) (PointWiseV2) [02/13/2023-19:56:57] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.678587 [02/13/2023-19:56:58] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.651063 [02/13/2023-19:56:58] [V] [TRT] Tactic: 0x000000000000001a Time: 0.585637 [02/13/2023-19:56:58] [V] [TRT] Tactic: 0x000000000000001b Time: 0.604878 [02/13/2023-19:56:59] [V] [TRT] Tactic: 0x000000000000001f Time: 0.672768 [02/13/2023-19:56:59] [V] [TRT] Fastest Tactic: 0x000000000000001a Time: 0.585637 [02/13/2023-19:56:59] [V] [TRT] --------------- Timing Runner: PWN(Mul_305, Sub_306) (PointWise) [02/13/2023-19:56:59] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:56:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001a [02/13/2023-19:56:59] [V] [TRT] *************** Autotuning format combination: Float(1:4,147456,512,1), Float(1:4,147456,512,1), Float(1:4,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:56:59] [V] [TRT] --------------- Timing Runner: PWN(Mul_305, Sub_306) (PointWiseV2) [02/13/2023-19:56:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.03412 [02/13/2023-19:56:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 2.13762 [02/13/2023-19:57:00] [V] [TRT] Tactic: 0x0000000000000002 Time: 2.29307 [02/13/2023-19:57:00] [V] [TRT] Tactic: 0x0000000000000003 Time: 2.77755 [02/13/2023-19:57:00] [V] [TRT] Tactic: 0x0000000000000004 Time: 2.89539 [02/13/2023-19:57:01] [V] [TRT] Tactic: 0x0000000000000005 Time: 2.33066 [02/13/2023-19:57:01] [V] [TRT] Tactic: 0x0000000000000006 Time: 4.19512 [02/13/2023-19:57:02] [V] [TRT] Tactic: 0x0000000000000007 Time: 3.75952 [02/13/2023-19:57:02] [V] [TRT] Tactic: 0x0000000000000008 Time: 4.14944 [02/13/2023-19:57:02] [V] [TRT] Tactic: 0x0000000000000009 Time: 4.89064 [02/13/2023-19:57:03] [V] [TRT] Tactic: 0x000000000000000a Time: 1.36078 [02/13/2023-19:57:03] [V] [TRT] Tactic: 0x000000000000000b Time: 1.78741 [02/13/2023-19:57:03] [V] [TRT] Tactic: 0x000000000000000c Time: 1.49536 [02/13/2023-19:57:04] [V] [TRT] Tactic: 0x000000000000000d Time: 2.31413 [02/13/2023-19:57:04] [V] [TRT] Tactic: 0x000000000000000e Time: 2.59836 [02/13/2023-19:57:04] [V] [TRT] Tactic: 0x000000000000000f Time: 1.55556 [02/13/2023-19:57:05] [V] [TRT] Tactic: 0x0000000000000010 Time: 3.39125 [02/13/2023-19:57:05] [V] [TRT] Tactic: 0x0000000000000011 Time: 3.62325 [02/13/2023-19:57:06] [V] [TRT] Tactic: 0x0000000000000012 Time: 3.51017 [02/13/2023-19:57:06] [V] [TRT] Tactic: 0x0000000000000013 Time: 2.10093 [02/13/2023-19:57:06] [V] [TRT] Tactic: 0x0000000000000014 Time: 1.1429 [02/13/2023-19:57:07] [V] [TRT] Tactic: 0x0000000000000015 Time: 1.59325 [02/13/2023-19:57:07] [V] [TRT] Tactic: 0x0000000000000016 Time: 2.13279 [02/13/2023-19:57:07] [V] [TRT] Tactic: 0x0000000000000017 Time: 3.22837 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x000000000000001c Time: 0.345161 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x000000000000001d Time: 0.29344 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x000000000000001e Time: 0.228503 [02/13/2023-19:57:08] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.228503 [02/13/2023-19:57:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [02/13/2023-19:57:08] [V] [TRT] =============== Computing costs for [02/13/2023-19:57:08] [V] [TRT] *************** Autotuning format combination: Float(3538944,147456,512,1) -> Float(2359296,147456,512,1) *************** [02/13/2023-19:57:08] [V] [TRT] --------------- Timing Runner: Conv_312 + Relu_313 (CudaDepthwiseConvolution) [02/13/2023-19:57:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:57:08] [V] [TRT] --------------- Timing Runner: Conv_312 + Relu_313 (FusedConvActConvolution) [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.686254 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.767931 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.566071 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x00000000000cffff Time: 1.26597 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.538286 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.584782 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.748951 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.534126 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.509746 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.574382 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.943099 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x000000000057ffff Time: 1.4904 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x00000000005effff Time: 0.571063 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.686862 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.513623 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.76261 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.602903 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.954917 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.550267 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.634482 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.724526 [02/13/2023-19:57:08] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.558944 [02/13/2023-19:57:08] [V] [TRT] Fastest Tactic: 0x00000000004bffff Time: 0.509746 [02/13/2023-19:57:08] [V] [TRT] --------------- Timing Runner: Conv_312 + Relu_313 (CudnnConvolution) [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.459986 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.435397 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.680919 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.801504 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.457303 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.436407 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x000000000000003a Time: 0.643515 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x000000000000003d Time: 0.814226 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.458674 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.433088 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.652078 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.804247 [02/13/2023-19:57:09] [V] [TRT] Fastest Tactic: 0x0000000000000071 Time: 0.433088 [02/13/2023-19:57:09] [V] [TRT] --------------- Timing Runner: Conv_312 + Relu_313 (CublasConvolution) [02/13/2023-19:57:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:57:09] [V] [TRT] --------------- Timing Runner: Conv_312 + Relu_313 (CaskConvolution) [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 1.3301 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.610016 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.564987 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.731104 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.428713 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x20109de926a12263 Time: 1.1571 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 1.70624 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.680722 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.299712 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 1.16773 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.599127 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.754267 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 0.953806 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.497504 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.745147 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.417819 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 1.04894 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.813161 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 1.1895 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.579803 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.644334 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.437637 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.445554 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.185179 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.839552 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 1.58981 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:57:09] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.54917 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.190843 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.594565 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:57:09] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.88043 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.291104 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 1.20143 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.477582 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 0.987767 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:57:09] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.601079 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.304928 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.758642 [02/13/2023-19:57:09] [V] [TRT] Fastest Tactic: 0x9808072e706def96 Time: 0.185179 [02/13/2023-19:57:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9808072e706def96 [02/13/2023-19:57:09] [V] [TRT] *************** Autotuning format combination: Float(3538944,1,12288,24) -> Float(2359296,1,8192,16) *************** [02/13/2023-19:57:09] [V] [TRT] --------------- Timing Runner: Conv_312 + Relu_313 (CublasConvolution) [02/13/2023-19:57:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:57:09] [V] [TRT] --------------- Timing Runner: Conv_312 + Relu_313 (CaskConvolution) [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.676133 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.167744 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.292407 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.467314 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.161559 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.211177 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.191141 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.259913 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.404539 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.29861 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.35403 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.192238 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.329623 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.330162 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.188325 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.156942 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.405093 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.196727 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.195113 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.470747 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.346752 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.233353 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.47408 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.444087 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.357019 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.187136 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.331982 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:57:09] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.603438 [02/13/2023-19:57:09] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.577403 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.40192 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.157618 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.468311 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.200745 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.202889 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.410839 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.338363 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.215881 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.211415 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.169536 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.172155 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.283813 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.52896 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.194981 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.347081 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.391017 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.162642 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.16661 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.192759 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.162702 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xba269390692faead Time: 0.5408 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.424014 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.36533 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.645239 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.324526 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.165019 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.195534 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.332571 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.476192 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.19131 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.46261 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.180155 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.626473 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.460064 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.34608 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.174725 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.169577 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.502784 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.157673 [02/13/2023-19:57:10] [V] [TRT] Fastest Tactic: 0x4037b478ce77e422 Time: 0.156942 [02/13/2023-19:57:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4037b478ce77e422 [02/13/2023-19:57:10] [V] [TRT] *************** Autotuning format combination: Float(884736,1:4,3072,6) -> Float(589824,1:4,2048,4) *************** [02/13/2023-19:57:10] [V] [TRT] --------------- Timing Runner: Conv_312 + Relu_313 (CublasConvolution) [02/13/2023-19:57:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:57:10] [V] [TRT] --------------- Timing Runner: Conv_312 + Relu_313 (CaskConvolution) [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.164229 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.313147 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.165257 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.221815 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.192855 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.299973 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.337522 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.168325 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.186523 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.159017 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.192037 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.17189 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.592768 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.46123 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.310734 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.594459 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.299003 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.428283 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.778245 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.750752 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.522775 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.24747 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.29728 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.28117 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.539003 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.300613 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.29371 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.240608 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.268942 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.366322 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.769993 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.272978 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.506757 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.242793 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.273728 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.270359 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.28325 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xba269390692faead Time: 0.767241 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.601719 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.247845 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.297381 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.275662 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.293632 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.886953 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.652443 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.491013 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.297746 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:57:10] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.274734 [02/13/2023-19:57:10] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:57:11] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.270766 [02/13/2023-19:57:11] [V] [TRT] Fastest Tactic: 0x4037b478ce77e422 Time: 0.159017 [02/13/2023-19:57:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4037b478ce77e422 [02/13/2023-19:57:11] [V] [TRT] =============== Computing costs for [02/13/2023-19:57:11] [V] [TRT] *************** Autotuning format combination: Float(2359296,147456,512,1) -> Float(2359296,147456,512,1) *************** [02/13/2023-19:57:11] [V] [TRT] --------------- Timing Runner: Conv_314 + Relu_315 (CudaDepthwiseConvolution) [02/13/2023-19:57:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:57:11] [V] [TRT] --------------- Timing Runner: Conv_314 + Relu_315 (FusedConvActConvolution) [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.832599 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.824494 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.688576 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000000cffff Time: 1.54871 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000011ffff Time: 0.828942 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.621202 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.682487 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.820672 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000003cffff Time: 0.597138 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.646171 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000045ffff Time: 0.542505 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000046ffff Time: 0.918551 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000004affff Time: 0.586501 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.644709 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000004effff Time: 0.852539 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.705723 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000051ffff Time: 0.945563 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000054ffff Time: 1.04872 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000057ffff Time: 1.5569 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000059ffff Time: 0.923456 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000005effff Time: 0.65893 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000005fffff Time: 0.833024 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.821545 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.583726 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.893833 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.685353 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000006fffff Time: 0.934341 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000072ffff Time: 1.04462 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.646903 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.760178 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.849349 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000091ffff Time: 0.588709 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x00000000009dffff Time: 0.615826 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.655177 [02/13/2023-19:57:11] [V] [TRT] Fastest Tactic: 0x000000000045ffff Time: 0.542505 [02/13/2023-19:57:11] [V] [TRT] --------------- Timing Runner: Conv_314 + Relu_315 (CudnnConvolution) [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.698839 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.659351 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.901518 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.01064 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.696027 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.669824 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000000003a Time: 0.899771 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x000000000000003d Time: 1.00396 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.630715 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.598761 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.828942 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x0000000000000075 Time: 1.036 [02/13/2023-19:57:11] [V] [TRT] Fastest Tactic: 0x0000000000000071 Time: 0.598761 [02/13/2023-19:57:11] [V] [TRT] --------------- Timing Runner: Conv_314 + Relu_315 (CublasConvolution) [02/13/2023-19:57:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:57:11] [V] [TRT] --------------- Timing Runner: Conv_314 + Relu_315 (CaskConvolution) [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 1.84709 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.819237 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.770414 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.986752 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.523291 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x20109de926a12263 Time: 1.61197 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 2.17708 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.944475 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.368713 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 1.64523 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.687616 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.96453 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 1.24315 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.632087 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.942661 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.522825 [02/13/2023-19:57:11] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:57:11] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 1.32932 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 1.0186 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 1.50581 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.696608 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.814491 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.489728 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.506368 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.216859 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.958949 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 1.80837 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.646295 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.219808 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.663726 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 1.01485 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.333687 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 1.52468 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.550802 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 1.24132 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.67696 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.343072 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.858057 [02/13/2023-19:57:12] [V] [TRT] Fastest Tactic: 0x9808072e706def96 Time: 0.216859 [02/13/2023-19:57:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9808072e706def96 [02/13/2023-19:57:12] [V] [TRT] *************** Autotuning format combination: Float(2359296,1,8192,16) -> Float(2359296,1,8192,16) *************** [02/13/2023-19:57:12] [V] [TRT] --------------- Timing Runner: Conv_314 + Relu_315 (CublasConvolution) [02/13/2023-19:57:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:57:12] [V] [TRT] --------------- Timing Runner: Conv_314 + Relu_315 (CaskConvolution) [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.771781 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.163255 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.327323 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.507739 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.161289 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.264485 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.202158 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.32656 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.418981 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.385915 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.405211 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.18165 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.426098 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.423913 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.203986 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.164626 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.419186 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.200306 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.200018 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.605467 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.448041 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.287899 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.51568 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.573344 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.405321 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.203369 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.420165 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.778606 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.748736 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.523621 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.164261 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.508361 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.198007 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.199406 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.531662 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.381362 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.297431 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.297381 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.161198 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.161678 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.314336 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.680869 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.203803 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.441531 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.404658 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.163145 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.179232 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.203717 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.183634 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xba269390692faead Time: 0.703205 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.547022 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.421257 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.731273 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.417682 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.163858 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.199959 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.378085 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.51744 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.202779 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.503575 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:57:12] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.24555 [02/13/2023-19:57:12] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.803182 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.591067 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.448626 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.200489 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.198455 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.508919 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.16437 [02/13/2023-19:57:13] [V] [TRT] Fastest Tactic: 0x96467934a22da27d Time: 0.161198 [02/13/2023-19:57:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x96467934a22da27d [02/13/2023-19:57:13] [V] [TRT] *************** Autotuning format combination: Float(589824,1:4,2048,4) -> Float(589824,1:4,2048,4) *************** [02/13/2023-19:57:13] [V] [TRT] --------------- Timing Runner: Conv_314 + Relu_315 (CublasConvolution) [02/13/2023-19:57:13] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:57:13] [V] [TRT] --------------- Timing Runner: Conv_314 + Relu_315 (CaskConvolution) [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.163721 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.326523 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.163109 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.266587 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.203104 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.325513 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.386098 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.180027 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.203273 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.164695 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.201344 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.201189 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.611118 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.45189 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.288955 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.572105 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.20256 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.420786 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.779054 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.749893 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.522907 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.162569 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.203401 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.203968 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.537207 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.303122 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.303634 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.162693 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.162322 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.314729 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.684969 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.205307 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.439095 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.162469 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.177477 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.20229 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.183177 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xba269390692faead Time: 0.702162 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.547598 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.164421 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.20304 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.20325 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.246962 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.807744 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.597371 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.447127 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.202491 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.20181 [02/13/2023-19:57:13] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:57:13] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.162473 [02/13/2023-19:57:13] [V] [TRT] Fastest Tactic: 0x9cb304e2edbc1221 Time: 0.162322 [02/13/2023-19:57:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:57:13] [V] [TRT] =============== Computing costs for [02/13/2023-19:57:13] [V] [TRT] *************** Autotuning format combination: Float(2359296,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:57:13] [V] [TRT] --------------- Timing Runner: Conv_316 (CudaDepthwiseConvolution) [02/13/2023-19:57:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/13/2023-19:57:13] [V] [TRT] --------------- Timing Runner: Conv_316 (FusedConvActConvolution) [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000008ffff Time: 0.515575 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000009ffff Time: 0.724549 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000000bffff Time: 0.308375 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000000cffff Time: 1.32049 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000011ffff Time: 0.681842 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000018ffff Time: 0.418889 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000035ffff Time: 0.536361 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000003bffff Time: 0.679378 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000003cffff Time: 0.371895 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000003fffff Time: 0.284713 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000045ffff Time: 0.306729 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000046ffff Time: 0.728567 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000004affff Time: 0.389979 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000004bffff Time: 0.261682 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000004effff Time: 0.680498 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000004fffff Time: 0.395003 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000051ffff Time: 0.723301 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000054ffff Time: 0.926674 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000057ffff Time: 1.05578 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000059ffff Time: 0.730789 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000005effff Time: 0.462903 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000005fffff Time: 0.675433 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000067ffff Time: 0.441541 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000006bffff Time: 0.454427 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000006cffff Time: 0.544526 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000006dffff Time: 0.411163 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000006fffff Time: 0.743355 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000072ffff Time: 0.816485 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000075ffff Time: 0.525673 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000007cffff Time: 0.344539 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000084ffff Time: 0.528055 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x000000000091ffff Time: 0.392512 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x00000000009dffff Time: 0.397042 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x0000000000a3ffff Time: 0.50459 [02/13/2023-19:57:13] [V] [TRT] Fastest Tactic: 0x00000000004bffff Time: 0.261682 [02/13/2023-19:57:13] [V] [TRT] --------------- Timing Runner: Conv_316 (CudnnConvolution) [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.217266 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.160594 [02/13/2023-19:57:13] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.385573 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.497129 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x0000000000000038 Time: 0.216384 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x0000000000000039 Time: 0.165312 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x000000000000003a Time: 0.387849 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x000000000000003d Time: 0.505627 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x0000000000000070 Time: 0.216709 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x0000000000000071 Time: 0.233952 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x0000000000000072 Time: 0.377609 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x0000000000000075 Time: 0.502171 [02/13/2023-19:57:14] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.160594 [02/13/2023-19:57:14] [V] [TRT] --------------- Timing Runner: Conv_316 (CublasConvolution) [02/13/2023-19:57:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:57:14] [V] [TRT] --------------- Timing Runner: Conv_316 (CaskConvolution) [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x089fce8f59784020 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x089fce8f59784020 Time: 1.67442 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x09aeee2f1beac383 Time: 0.722633 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x1016909b1fd6ff2f Time: 0.699131 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x126c151fbf444788 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x126c151fbf444788 Time: 0.890405 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x1fc87d7eb370bb7a Time: 0.463442 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x20109de926a12263 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x20109de926a12263 Time: 1.44891 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x2ee10e11d6651675 Time: 1.9448 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x37f7c166cac77c6f [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x37f7c166cac77c6f Time: 0.793417 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x3f243c490d502deb Time: 0.288037 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x44429615b0244d08 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x44429615b0244d08 Time: 1.35122 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x503619c69ae500ff Time: 0.601385 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x5104686f63bb0267 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x5104686f63bb0267 Time: 0.836846 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x55952bdf9713ff4e [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x55952bdf9713ff4e Time: 1.07449 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x562e86db2b553d73 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x562e86db2b553d73 Time: 0.558354 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5a37b78cd3b8724f [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x5a37b78cd3b8724f Time: 0.843899 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x5d4d781b2e89fd83 Time: 0.45584 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x5f5015dbf902f0a3 Time: 1.15528 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5fc609cfe7c5b7d9 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x5fc609cfe7c5b7d9 Time: 0.874967 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x6fb0aa4a23519390 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x6fb0aa4a23519390 Time: 1.32019 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x7f0145cb49517338 Time: 0.627255 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x84ce4136c9dcccb4 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x84ce4136c9dcccb4 Time: 0.723813 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x865894c4635db7fd Time: 0.430368 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x8e3884f0eaec3ecd Time: 0.449079 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x9808072e706def96 Time: 0.161751 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x9cd5cdc35441c505 Time: 0.841344 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x9de226a0c44627c4 Time: 1.60273 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xa419b3b68f2da07b Time: 0.580229 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xa8609adc4e0ceb90 Time: 0.166258 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xa8ef60e712f8ad24 Time: 0.586482 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xc0b05b61d128e46e Time: 0.896585 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xc3cf6e1d1c6aff27 Time: 0.276439 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xd97544c2f30ecbf9 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xd97544c2f30ecbf9 Time: 1.35402 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xe5603263b7f00303 Time: 0.483447 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0xed454ebf201fb878 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xed454ebf201fb878 Time: 1.08316 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xf067e6205da31c2e Time: 0.595721 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xf64396b97c889179 Time: 0.288315 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xfff46c7893896eb1 Time: 0.760311 [02/13/2023-19:57:14] [V] [TRT] Fastest Tactic: 0x9808072e706def96 Time: 0.161751 [02/13/2023-19:57:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000001 [02/13/2023-19:57:14] [V] [TRT] *************** Autotuning format combination: Float(2359296,1,8192,16) -> Float(589824,1,2048,4) *************** [02/13/2023-19:57:14] [V] [TRT] --------------- Timing Runner: Conv_316 (CublasConvolution) [02/13/2023-19:57:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:57:14] [V] [TRT] --------------- Timing Runner: Conv_316 (CaskConvolution) [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x1022069e6f8d9aeb Time: 0.689417 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.0933326 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.283154 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0x17173deba0b64484 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x17173deba0b64484 Time: 0.447602 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.0714194 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.234907 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.156343 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.278222 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x27b316f52c109002 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x27b316f52c109002 Time: 0.362039 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.317509 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x35f26f9c09557d86 Time: 0.361792 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.139143 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x3e191488237fab8f [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x3e191488237fab8f Time: 0.369678 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x3e2b881168d9689d [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x3e2b881168d9689d Time: 0.365033 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.0971429 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.0937394 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x412c44dfeaf9161d [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x412c44dfeaf9161d Time: 0.363392 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.0965326 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.0976206 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.511305 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.380494 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.242903 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x5030121339a48bf3 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x5030121339a48bf3 Time: 0.452023 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.494729 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x55d80c17b1cd982d Time: 0.365175 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.0973371 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.373115 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.65936 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.591808 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.417746 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.0736777 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x7bc32c782b800c48 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x7bc32c782b800c48 Time: 0.416146 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.0959131 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.0965166 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.414194 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x90898977fc8ce537 Time: 0.315744 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.188416 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.184837 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.0709714 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.0722103 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.253865 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.537842 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.112935 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.360146 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xae0c89d047932ba3 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xae0c89d047932ba3 Time: 0.327246 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.0708206 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.125957 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.0962377 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.132683 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xba269390692faead Time: 0.551017 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.435264 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xbc0bba0ff1a92939 Time: 0.338501 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xc7b3afceb5fb03c0 Time: 0.601211 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xc7feb33970feefa7 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xc7feb33970feefa7 Time: 0.334487 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.0894469 [02/13/2023-19:57:14] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:57:14] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.0959314 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xd55ee6fd0b56f808 Time: 0.310821 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0xd9031472c05adf51 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xd9031472c05adf51 Time: 0.418185 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.096352 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xe47307053a42b3e4 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xe47307053a42b3e4 Time: 0.408137 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.144242 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.654985 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.463886 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.347826 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.0962994 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.0957943 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0xf90060ce8193b811 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xf90060ce8193b811 Time: 0.411291 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.0743954 [02/13/2023-19:57:15] [V] [TRT] Fastest Tactic: 0xae48d3ccfe1edfcd Time: 0.0708206 [02/13/2023-19:57:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:57:15] [V] [TRT] *************** Autotuning format combination: Float(589824,1:4,2048,4) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:57:15] [V] [TRT] --------------- Timing Runner: Conv_316 (CublasConvolution) [02/13/2023-19:57:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [02/13/2023-19:57:15] [V] [TRT] --------------- Timing Runner: Conv_316 (CaskConvolution) [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x10383a0781d24dde Time: 0.087312 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x130df49cb195156b Time: 0.261253 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x1a373db9a2bc4028 Time: 0.0710964 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x1acd4f006848c62b Time: 0.215451 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x22cadc265a3b2e32 Time: 0.143922 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x233399c4b9cc77c1 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x233399c4b9cc77c1 Time: 0.256018 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2b4a5a2f546acbfd [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x2b4a5a2f546acbfd Time: 0.295461 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x3a8712b17741b582 Time: 0.130005 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x3f948a101b8c4067 Time: 0.0967337 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x4037b478ce77e422 Time: 0.0882583 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x43ffe5cf09cee087 Time: 0.0960891 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x4640eb34c8ecc700 Time: 0.0964183 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x46e3f4ab19d1017d [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x46e3f4ab19d1017d Time: 0.476823 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x4aa9c14ea2943ef0 Time: 0.355333 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4ddd867d1da71041 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x4ddd867d1da71041 Time: 0.225239 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x53b347fe11460a8e [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x53b347fe11460a8e Time: 0.458615 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x570667f2a28165a0 Time: 0.0961326 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x591671c3dd9388cc [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x591671c3dd9388cc Time: 0.347831 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x5b317e1cbcf34d49 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x5b317e1cbcf34d49 Time: 0.629093 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x5ed17eb1dfe2e6b0 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x5ed17eb1dfe2e6b0 Time: 0.590459 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x61f62003626e5959 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x61f62003626e5959 Time: 0.413787 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x72a5d05b1bb165ef Time: 0.0730651 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x7bff86d5f2eadc76 Time: 0.0956983 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x7e40882e33c8fbf1 Time: 0.0963406 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x85222248e9a8aead [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x85222248e9a8aead Time: 0.41179 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x93030576a9fb03f9 Time: 0.188942 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x9355e195cee05798 Time: 0.184475 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x96467934a22da27d Time: 0.0708023 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x9cb304e2edbc1221 Time: 0.0716823 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x9dece0dc37e90462 Time: 0.254565 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xa71326710e3f683c [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xa71326710e3f683c Time: 0.537774 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xab0496509b88ebe0 Time: 0.113815 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xabb79847ce7b82ce [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xabb79847ce7b82ce Time: 0.362382 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xae48d3ccfe1edfcd Time: 0.0708907 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xb33296dda7141c64 Time: 0.127296 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xb3e5ce9d1b1da232 Time: 0.095792 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xb6f6563c77d057d7 Time: 0.132519 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba269390692faead [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xba269390692faead Time: 0.55349 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xba76ca882b17caa6 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xba76ca882b17caa6 Time: 0.437687 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xcc46f0f5cee60677 Time: 0.08872 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xcf8ea142095f02d2 Time: 0.0969874 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xdb77237fa21087f5 Time: 0.0954126 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xe9e5475c77d60638 Time: 0.14443 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xebdd7d350fbaa00e [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xebdd7d350fbaa00e Time: 0.656096 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xed09dcddfcf4bffb [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xed09dcddfcf4bffb Time: 0.463904 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xf031e640742524d7 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xf031e640742524d7 Time: 0.34901 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xf231cca3335919a4 Time: 0.0965349 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xf78ec258f27b3e23 Time: 0.0958446 [02/13/2023-19:57:15] [V] [TRT] Conv_316 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba [02/13/2023-19:57:15] [V] [TRT] Tactic: 0xfed494d61b2087ba Time: 0.0748206 [02/13/2023-19:57:15] [V] [TRT] Fastest Tactic: 0x96467934a22da27d Time: 0.0708023 [02/13/2023-19:57:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x96467934a22da27d [02/13/2023-19:57:15] [V] [TRT] =============== Computing costs for [02/13/2023-19:57:15] [V] [TRT] *************** Autotuning format combination: Float(589824,147456,512,1), Float(589824,147456,512,1), Float(589824,147456,512,1) -> Float(589824,147456,512,1) *************** [02/13/2023-19:57:15] [V] [TRT] *************** Autotuning format combination: Float(589824,1,2048,4), Float(589824,1,2048,4), Float(589824,1,2048,4) -> Float(589824,1,2048,4) *************** [02/13/2023-19:57:15] [V] [TRT] *************** Autotuning format combination: Float(147456,1:4,512,1), Float(147456,1:4,512,1), Float(147456,1:4,512,1) -> Float(147456,1:4,512,1) *************** [02/13/2023-19:57:15] [V] [TRT] *************** Autotuning format combination: Float(147456,147456:32,512,1), Float(147456,147456:32,512,1), Float(147456,147456:32,512,1) -> Float(147456,147456:32,512,1) *************** [02/13/2023-19:57:15] [V] [TRT] *************** Autotuning format combination: Float(1:4,147456,512,1), Float(1:4,147456,512,1), Float(1:4,147456,512,1) -> Float(1:4,147456,512,1) *************** [02/13/2023-19:57:15] [V] [TRT] =============== Computing costs for [02/13/2023-19:57:15] [V] [TRT] *************** Autotuning format combination: Float(589824,147456,512,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:57:15] [V] [TRT] --------------- Timing Runner: Resize_332 (Resize) [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.886528 [02/13/2023-19:57:15] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.886528 [02/13/2023-19:57:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 [02/13/2023-19:57:15] [V] [TRT] =============== Computing costs for [02/13/2023-19:57:15] [V] [TRT] *************** Autotuning format combination: Float(589824,147456,512,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:57:15] [V] [TRT] --------------- Timing Runner: Resize_346 (Resize) [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.886592 [02/13/2023-19:57:15] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.886592 [02/13/2023-19:57:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 [02/13/2023-19:57:15] [V] [TRT] =============== Computing costs for [02/13/2023-19:57:15] [V] [TRT] *************** Autotuning format combination: Float(14745600,3686400,2560,1), Float(14745600,3686400,2560,1), Float(14745600,3686400,2560,1) -> Float(14745600,3686400,2560,1) *************** [02/13/2023-19:57:15] [V] [TRT] --------------- Timing Runner: PWN(Mul_347, Add_348) (PointWiseV2) [02/13/2023-19:57:15] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.23906 [02/13/2023-19:57:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 1.51908 [02/13/2023-19:57:16] [V] [TRT] Tactic: 0x0000000000000002 Time: 1.64003 [02/13/2023-19:57:16] [V] [TRT] Tactic: 0x0000000000000003 Time: 1.52277 [02/13/2023-19:57:17] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.64306 [02/13/2023-19:57:17] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.39441 [02/13/2023-19:57:17] [V] [TRT] Tactic: 0x0000000000000006 Time: 1.23021 [02/13/2023-19:57:18] [V] [TRT] Tactic: 0x0000000000000007 Time: 1.39403 [02/13/2023-19:57:18] [V] [TRT] Tactic: 0x0000000000000008 Time: 1.58925 [02/13/2023-19:57:19] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.42665 [02/13/2023-19:57:19] [V] [TRT] Tactic: 0x000000000000001c Time: 1.58813 [02/13/2023-19:57:19] [V] [TRT] Fastest Tactic: 0x0000000000000006 Time: 1.23021 [02/13/2023-19:57:19] [V] [TRT] --------------- Timing Runner: PWN(Mul_347, Add_348) (PointWise) [02/13/2023-19:57:19] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:57:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000006 [02/13/2023-19:57:19] [V] [TRT] *************** Autotuning format combination: Float(14745600,1,10240,4), Float(14745600,1,10240,4), Float(14745600,1,10240,4) -> Float(14745600,1,10240,4) *************** [02/13/2023-19:57:19] [V] [TRT] --------------- Timing Runner: PWN(Mul_347, Add_348) (PointWiseV2) [02/13/2023-19:57:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.4116 [02/13/2023-19:57:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 1.2267 [02/13/2023-19:57:19] [V] [TRT] Tactic: 0x0000000000000002 Time: 1.41464 [02/13/2023-19:57:19] [V] [TRT] Tactic: 0x0000000000000003 Time: 1.82727 [02/13/2023-19:57:19] [V] [TRT] Tactic: 0x0000000000000004 Time: 1.39924 [02/13/2023-19:57:19] [V] [TRT] Tactic: 0x0000000000000005 Time: 1.65837 [02/13/2023-19:57:19] [V] [TRT] Tactic: 0x0000000000000006 Time: 1.50971 [02/13/2023-19:57:20] [V] [TRT] Tactic: 0x0000000000000007 Time: 1.22566 [02/13/2023-19:57:20] [V] [TRT] Tactic: 0x0000000000000008 Time: 1.37866 [02/13/2023-19:57:20] [V] [TRT] Tactic: 0x0000000000000009 Time: 1.73448 [02/13/2023-19:57:20] [V] [TRT] Tactic: 0x000000000000001c Time: 1.4057 [02/13/2023-19:57:20] [V] [TRT] Fastest Tactic: 0x0000000000000007 Time: 1.22566 [02/13/2023-19:57:20] [V] [TRT] --------------- Timing Runner: PWN(Mul_347, Add_348) (PointWise) [02/13/2023-19:57:20] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:57:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000007 [02/13/2023-19:57:20] [V] [TRT] *************** Autotuning format combination: Float(3686400,1:4,2560,1), Float(3686400,1:4,2560,1), Float(3686400,1:4,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:57:20] [V] [TRT] --------------- Timing Runner: PWN(Mul_347, Add_348) (PointWiseV2) [02/13/2023-19:57:20] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.88978 [02/13/2023-19:57:20] [V] [TRT] Tactic: 0x0000000000000001 Time: 1.93513 [02/13/2023-19:57:21] [V] [TRT] Tactic: 0x0000000000000002 Time: 2.30128 [02/13/2023-19:57:21] [V] [TRT] Tactic: 0x0000000000000003 Time: 1.86481 [02/13/2023-19:57:22] [V] [TRT] Tactic: 0x0000000000000004 Time: 2.16707 [02/13/2023-19:57:22] [V] [TRT] Tactic: 0x0000000000000005 Time: 2.51134 [02/13/2023-19:57:22] [V] [TRT] Tactic: 0x0000000000000006 Time: 1.71588 [02/13/2023-19:57:23] [V] [TRT] Tactic: 0x0000000000000007 Time: 2.15279 [02/13/2023-19:57:23] [V] [TRT] Tactic: 0x0000000000000008 Time: 2.31165 [02/13/2023-19:57:24] [V] [TRT] Tactic: 0x0000000000000009 Time: 2.46348 [02/13/2023-19:57:24] [V] [TRT] Tactic: 0x000000000000000a Time: 1.49657 [02/13/2023-19:57:24] [V] [TRT] Tactic: 0x000000000000000b Time: 1.49441 [02/13/2023-19:57:25] [V] [TRT] Tactic: 0x000000000000000c Time: 1.8608 [02/13/2023-19:57:25] [V] [TRT] Tactic: 0x000000000000000d Time: 1.49251 [02/13/2023-19:57:26] [V] [TRT] Tactic: 0x000000000000000e Time: 1.65466 [02/13/2023-19:57:26] [V] [TRT] Tactic: 0x000000000000000f Time: 2.27391 [02/13/2023-19:57:26] [V] [TRT] Tactic: 0x0000000000000010 Time: 1.4923 [02/13/2023-19:57:27] [V] [TRT] Tactic: 0x0000000000000011 Time: 1.98031 [02/13/2023-19:57:27] [V] [TRT] Tactic: 0x0000000000000012 Time: 2.00175 [02/13/2023-19:57:28] [V] [TRT] Tactic: 0x0000000000000013 Time: 2.45394 [02/13/2023-19:57:28] [V] [TRT] Tactic: 0x0000000000000014 Time: 1.236 [02/13/2023-19:57:28] [V] [TRT] Tactic: 0x0000000000000015 Time: 1.50643 [02/13/2023-19:57:29] [V] [TRT] Tactic: 0x0000000000000016 Time: 1.22539 [02/13/2023-19:57:29] [V] [TRT] Tactic: 0x0000000000000017 Time: 1.51323 [02/13/2023-19:57:29] [V] [TRT] Tactic: 0x000000000000001c Time: 1.88724 [02/13/2023-19:57:30] [V] [TRT] Tactic: 0x000000000000001d Time: 1.54104 [02/13/2023-19:57:30] [V] [TRT] Tactic: 0x000000000000001e Time: 1.23973 [02/13/2023-19:57:30] [V] [TRT] Fastest Tactic: 0x0000000000000016 Time: 1.22539 [02/13/2023-19:57:30] [V] [TRT] --------------- Timing Runner: PWN(Mul_347, Add_348) (PointWise) [02/13/2023-19:57:30] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:57:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000016 [02/13/2023-19:57:30] [V] [TRT] *************** Autotuning format combination: Float(3686400,3686400:32,2560,1), Float(3686400,3686400:32,2560,1), Float(3686400,3686400:32,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:57:30] [V] [TRT] --------------- Timing Runner: PWN(Mul_347, Add_348) (PointWiseV2) [02/13/2023-19:57:31] [V] [TRT] Tactic: 0x0000000000000018 Time: 16.9792 [02/13/2023-19:57:32] [V] [TRT] Tactic: 0x0000000000000019 Time: 14.9828 [02/13/2023-19:57:33] [V] [TRT] Tactic: 0x000000000000001a Time: 14.7331 [02/13/2023-19:57:34] [V] [TRT] Tactic: 0x000000000000001b Time: 14.4488 [02/13/2023-19:57:35] [V] [TRT] Tactic: 0x000000000000001f Time: 17.043 [02/13/2023-19:57:35] [V] [TRT] Fastest Tactic: 0x000000000000001b Time: 14.4488 [02/13/2023-19:57:35] [V] [TRT] --------------- Timing Runner: PWN(Mul_347, Add_348) (PointWise) [02/13/2023-19:57:35] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:57:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001b [02/13/2023-19:57:35] [V] [TRT] *************** Autotuning format combination: Float(1:4,3686400,2560,1), Float(1:4,3686400,2560,1), Float(1:4,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:57:35] [V] [TRT] --------------- Timing Runner: PWN(Mul_347, Add_348) (PointWiseV2) [02/13/2023-19:57:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 50.6428 [02/13/2023-19:57:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 53.1143 [02/13/2023-19:57:38] [V] [TRT] Tactic: 0x0000000000000002 Time: 56.3896 [02/13/2023-19:57:39] [V] [TRT] Tactic: 0x0000000000000003 Time: 69.1737 [02/13/2023-19:57:40] [V] [TRT] Tactic: 0x0000000000000004 Time: 72.1853 [02/13/2023-19:57:41] [V] [TRT] Tactic: 0x0000000000000005 Time: 58.4074 [02/13/2023-19:57:42] [V] [TRT] Tactic: 0x0000000000000006 Time: 104.711 [02/13/2023-19:57:44] [V] [TRT] Tactic: 0x0000000000000007 Time: 93.9824 [02/13/2023-19:57:45] [V] [TRT] Tactic: 0x0000000000000008 Time: 103.597 [02/13/2023-19:57:47] [V] [TRT] Tactic: 0x0000000000000009 Time: 123.441 [02/13/2023-19:57:48] [V] [TRT] Tactic: 0x000000000000000a Time: 34.5114 [02/13/2023-19:57:48] [V] [TRT] Tactic: 0x000000000000000b Time: 44.7322 [02/13/2023-19:57:49] [V] [TRT] Tactic: 0x000000000000000c Time: 37.6441 [02/13/2023-19:57:50] [V] [TRT] Tactic: 0x000000000000000d Time: 57.7901 [02/13/2023-19:57:51] [V] [TRT] Tactic: 0x000000000000000e Time: 64.9828 [02/13/2023-19:57:52] [V] [TRT] Tactic: 0x000000000000000f Time: 39.1495 [02/13/2023-19:57:54] [V] [TRT] Tactic: 0x0000000000000010 Time: 84.678 [02/13/2023-19:57:55] [V] [TRT] Tactic: 0x0000000000000011 Time: 90.5096 [02/13/2023-19:57:56] [V] [TRT] Tactic: 0x0000000000000012 Time: 87.9043 [02/13/2023-19:57:57] [V] [TRT] Tactic: 0x0000000000000013 Time: 53.4165 [02/13/2023-19:57:58] [V] [TRT] Tactic: 0x0000000000000014 Time: 29.1522 [02/13/2023-19:57:59] [V] [TRT] Tactic: 0x0000000000000015 Time: 39.8734 [02/13/2023-19:58:00] [V] [TRT] Tactic: 0x0000000000000016 Time: 53.5503 [02/13/2023-19:58:01] [V] [TRT] Tactic: 0x0000000000000017 Time: 80.6298 [02/13/2023-19:58:02] [V] [TRT] Tactic: 0x000000000000001c Time: 7.97591 [02/13/2023-19:58:02] [V] [TRT] Tactic: 0x000000000000001d Time: 7.10079 [02/13/2023-19:58:03] [V] [TRT] Tactic: 0x000000000000001e Time: 5.52559 [02/13/2023-19:58:03] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 5.52559 [02/13/2023-19:58:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [02/13/2023-19:58:03] [V] [TRT] =============== Computing costs for [02/13/2023-19:58:03] [V] [TRT] *************** Autotuning format combination: Float(14745600,3686400,2560,1), Float(11059200,3686400,2560,1) -> Float(11059200,3686400,2560,1) *************** [02/13/2023-19:58:03] [V] [TRT] --------------- Timing Runner: PWN(Add_350, PWN(Clip_351)) (PointWiseV2) [02/13/2023-19:58:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.82992 [02/13/2023-19:58:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.755525 [02/13/2023-19:58:04] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.704978 [02/13/2023-19:58:04] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.759639 [02/13/2023-19:58:04] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.779474 [02/13/2023-19:58:05] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.721061 [02/13/2023-19:58:05] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.901586 [02/13/2023-19:58:05] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.714418 [02/13/2023-19:58:06] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.711255 [02/13/2023-19:58:06] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.718203 [02/13/2023-19:58:07] [V] [TRT] Tactic: 0x000000000000001c Time: 0.836663 [02/13/2023-19:58:07] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.704978 [02/13/2023-19:58:07] [V] [TRT] --------------- Timing Runner: PWN(Add_350, PWN(Clip_351)) (PointWise) [02/13/2023-19:58:07] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [02/13/2023-19:58:07] [V] [TRT] *************** Autotuning format combination: Float(14745600,1,10240,4), Float(11059200,1,7680,3) -> Float(11059200,1,7680,3) *************** [02/13/2023-19:58:07] [V] [TRT] --------------- Timing Runner: PWN(Add_350, PWN(Clip_351)) (PointWiseV2) [02/13/2023-19:58:07] [V] [TRT] Tactic: 0x0000000000000000 Time: 6.00538 [02/13/2023-19:58:07] [V] [TRT] Tactic: 0x0000000000000001 Time: 7.20505 [02/13/2023-19:58:07] [V] [TRT] Tactic: 0x0000000000000002 Time: 6.61063 [02/13/2023-19:58:07] [V] [TRT] Tactic: 0x0000000000000003 Time: 8.73892 [02/13/2023-19:58:07] [V] [TRT] Tactic: 0x0000000000000004 Time: 9.96628 [02/13/2023-19:58:07] [V] [TRT] Tactic: 0x0000000000000005 Time: 7.67748 [02/13/2023-19:58:07] [V] [TRT] Tactic: 0x0000000000000006 Time: 11.9105 [02/13/2023-19:58:07] [V] [TRT] Tactic: 0x0000000000000007 Time: 12.4132 [02/13/2023-19:58:08] [V] [TRT] Tactic: 0x0000000000000008 Time: 11.8568 [02/13/2023-19:58:08] [V] [TRT] Tactic: 0x0000000000000009 Time: 10.5757 [02/13/2023-19:58:08] [V] [TRT] Tactic: 0x000000000000001c Time: 0.846578 [02/13/2023-19:58:08] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.846578 [02/13/2023-19:58:08] [V] [TRT] --------------- Timing Runner: PWN(Add_350, PWN(Clip_351)) (PointWise) [02/13/2023-19:58:08] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:58:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:58:08] [V] [TRT] *************** Autotuning format combination: Float(3686400,1:4,2560,1), Float(3686400,1:4,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:58:08] [V] [TRT] --------------- Timing Runner: PWN(Add_350, PWN(Clip_351)) (PointWiseV2) [02/13/2023-19:58:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 9.07397 [02/13/2023-19:58:09] [V] [TRT] Tactic: 0x0000000000000001 Time: 10.6634 [02/13/2023-19:58:09] [V] [TRT] Tactic: 0x0000000000000002 Time: 10.7439 [02/13/2023-19:58:09] [V] [TRT] Tactic: 0x0000000000000003 Time: 14.4127 [02/13/2023-19:58:10] [V] [TRT] Tactic: 0x0000000000000004 Time: 14.9769 [02/13/2023-19:58:10] [V] [TRT] Tactic: 0x0000000000000005 Time: 10.7411 [02/13/2023-19:58:11] [V] [TRT] Tactic: 0x0000000000000006 Time: 22.1265 [02/13/2023-19:58:11] [V] [TRT] Tactic: 0x0000000000000007 Time: 20.0364 [02/13/2023-19:58:12] [V] [TRT] Tactic: 0x0000000000000008 Time: 22.2111 [02/13/2023-19:58:13] [V] [TRT] Tactic: 0x0000000000000009 Time: 19.4791 [02/13/2023-19:58:13] [V] [TRT] Tactic: 0x000000000000000a Time: 7.55941 [02/13/2023-19:58:13] [V] [TRT] Tactic: 0x000000000000000b Time: 9.99999 [02/13/2023-19:58:14] [V] [TRT] Tactic: 0x000000000000000c Time: 8.65434 [02/13/2023-19:58:14] [V] [TRT] Tactic: 0x000000000000000d Time: 13.0209 [02/13/2023-19:58:15] [V] [TRT] Tactic: 0x000000000000000e Time: 12.5301 [02/13/2023-19:58:15] [V] [TRT] Tactic: 0x000000000000000f Time: 8.80865 [02/13/2023-19:58:16] [V] [TRT] Tactic: 0x0000000000000010 Time: 19.1975 [02/13/2023-19:58:16] [V] [TRT] Tactic: 0x0000000000000011 Time: 15.9735 [02/13/2023-19:58:17] [V] [TRT] Tactic: 0x0000000000000012 Time: 16.2473 [02/13/2023-19:58:17] [V] [TRT] Tactic: 0x0000000000000013 Time: 11.4406 [02/13/2023-19:58:18] [V] [TRT] Tactic: 0x0000000000000014 Time: 6.63876 [02/13/2023-19:58:18] [V] [TRT] Tactic: 0x0000000000000015 Time: 8.29728 [02/13/2023-19:58:18] [V] [TRT] Tactic: 0x0000000000000016 Time: 10.5069 [02/13/2023-19:58:19] [V] [TRT] Tactic: 0x0000000000000017 Time: 15.1317 [02/13/2023-19:58:19] [V] [TRT] Tactic: 0x000000000000001c Time: 1.21975 [02/13/2023-19:58:20] [V] [TRT] Tactic: 0x000000000000001d Time: 1.16064 [02/13/2023-19:58:20] [V] [TRT] Tactic: 0x000000000000001e Time: 1.16723 [02/13/2023-19:58:20] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 1.16064 [02/13/2023-19:58:20] [V] [TRT] --------------- Timing Runner: PWN(Add_350, PWN(Clip_351)) (PointWise) [02/13/2023-19:58:20] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:58:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [02/13/2023-19:58:20] [V] [TRT] *************** Autotuning format combination: Float(3686400,3686400:32,2560,1), Float(3686400,3686400:32,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:58:20] [V] [TRT] --------------- Timing Runner: PWN(Add_350, PWN(Clip_351)) (PointWiseV2) [02/13/2023-19:58:21] [V] [TRT] Tactic: 0x0000000000000018 Time: 10.7971 [02/13/2023-19:58:21] [V] [TRT] Tactic: 0x0000000000000019 Time: 10.1921 [02/13/2023-19:58:22] [V] [TRT] Tactic: 0x000000000000001a Time: 10.1647 [02/13/2023-19:58:23] [V] [TRT] Tactic: 0x000000000000001b Time: 9.90469 [02/13/2023-19:58:24] [V] [TRT] Tactic: 0x000000000000001f Time: 10.8753 [02/13/2023-19:58:24] [V] [TRT] Fastest Tactic: 0x000000000000001b Time: 9.90469 [02/13/2023-19:58:24] [V] [TRT] --------------- Timing Runner: PWN(Add_350, PWN(Clip_351)) (PointWise) [02/13/2023-19:58:24] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:58:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001b [02/13/2023-19:58:24] [V] [TRT] *************** Autotuning format combination: Float(1:4,3686400,2560,1), Float(1:4,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:58:24] [V] [TRT] --------------- Timing Runner: PWN(Add_350, PWN(Clip_351)) (PointWiseV2) [02/13/2023-19:58:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 27.8262 [02/13/2023-19:58:24] [V] [TRT] Tactic: 0x0000000000000001 Time: 32.3724 [02/13/2023-19:58:25] [V] [TRT] Tactic: 0x0000000000000002 Time: 32.716 [02/13/2023-19:58:25] [V] [TRT] Tactic: 0x0000000000000003 Time: 43.4287 [02/13/2023-19:58:26] [V] [TRT] Tactic: 0x0000000000000004 Time: 45.0978 [02/13/2023-19:58:26] [V] [TRT] Tactic: 0x0000000000000005 Time: 32.6639 [02/13/2023-19:58:27] [V] [TRT] Tactic: 0x0000000000000006 Time: 66.4319 [02/13/2023-19:58:28] [V] [TRT] Tactic: 0x0000000000000007 Time: 60.3004 [02/13/2023-19:58:28] [V] [TRT] Tactic: 0x0000000000000008 Time: 66.5953 [02/13/2023-19:58:29] [V] [TRT] Tactic: 0x0000000000000009 Time: 59.246 [02/13/2023-19:58:29] [V] [TRT] Tactic: 0x000000000000000a Time: 23.3502 [02/13/2023-19:58:30] [V] [TRT] Tactic: 0x000000000000000b Time: 30.26 [02/13/2023-19:58:30] [V] [TRT] Tactic: 0x000000000000000c Time: 26.4156 [02/13/2023-19:58:31] [V] [TRT] Tactic: 0x000000000000000d Time: 39.2815 [02/13/2023-19:58:31] [V] [TRT] Tactic: 0x000000000000000e Time: 37.7019 [02/13/2023-19:58:31] [V] [TRT] Tactic: 0x000000000000000f Time: 26.8965 [02/13/2023-19:58:32] [V] [TRT] Tactic: 0x0000000000000010 Time: 57.8337 [02/13/2023-19:58:32] [V] [TRT] Tactic: 0x0000000000000011 Time: 47.9752 [02/13/2023-19:58:33] [V] [TRT] Tactic: 0x0000000000000012 Time: 48.8042 [02/13/2023-19:58:33] [V] [TRT] Tactic: 0x0000000000000013 Time: 34.7556 [02/13/2023-19:58:34] [V] [TRT] Tactic: 0x0000000000000014 Time: 20.7185 [02/13/2023-19:58:34] [V] [TRT] Tactic: 0x0000000000000015 Time: 25.2248 [02/13/2023-19:58:34] [V] [TRT] Tactic: 0x0000000000000016 Time: 31.6187 [02/13/2023-19:58:35] [V] [TRT] Tactic: 0x0000000000000017 Time: 45.4309 [02/13/2023-19:58:35] [V] [TRT] Tactic: 0x000000000000001c Time: 3.8776 [02/13/2023-19:58:35] [V] [TRT] Tactic: 0x000000000000001d Time: 3.83937 [02/13/2023-19:58:36] [V] [TRT] Tactic: 0x000000000000001e Time: 3.66462 [02/13/2023-19:58:36] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 3.66462 [02/13/2023-19:58:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [02/13/2023-19:58:36] [V] [TRT] =============== Computing costs for [02/13/2023-19:58:36] [V] [TRT] *************** Autotuning format combination: Float(14745600,3686400,2560,1) -> Float(3686400,3686400,2560,1) *************** [02/13/2023-19:58:36] [V] [TRT] --------------- Timing Runner: PWN(Clip_352) (PointWiseV2) [02/13/2023-19:58:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.218779 [02/13/2023-19:58:36] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.191461 [02/13/2023-19:58:36] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.193605 [02/13/2023-19:58:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.174862 [02/13/2023-19:58:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.18859 [02/13/2023-19:58:37] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.159319 [02/13/2023-19:58:38] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.239209 [02/13/2023-19:58:38] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.160114 [02/13/2023-19:58:38] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.178985 [02/13/2023-19:58:39] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.159141 [02/13/2023-19:58:39] [V] [TRT] Tactic: 0x000000000000001c Time: 0.210921 [02/13/2023-19:58:39] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.159141 [02/13/2023-19:58:39] [V] [TRT] --------------- Timing Runner: PWN(Clip_352) (PointWise) [02/13/2023-19:58:39] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:58:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [02/13/2023-19:58:39] [V] [TRT] *************** Autotuning format combination: Float(14745600,1,10240,4) -> Float(3686400,1,2560,1) *************** [02/13/2023-19:58:39] [V] [TRT] --------------- Timing Runner: PWN(Clip_352) (PointWiseV2) [02/13/2023-19:58:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 5.6839 [02/13/2023-19:58:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 6.64863 [02/13/2023-19:58:39] [V] [TRT] Tactic: 0x0000000000000002 Time: 6.14542 [02/13/2023-19:58:39] [V] [TRT] Tactic: 0x0000000000000003 Time: 7.93122 [02/13/2023-19:58:39] [V] [TRT] Tactic: 0x0000000000000004 Time: 7.51579 [02/13/2023-19:58:39] [V] [TRT] Tactic: 0x0000000000000005 Time: 6.50824 [02/13/2023-19:58:40] [V] [TRT] Tactic: 0x0000000000000006 Time: 10.7037 [02/13/2023-19:58:40] [V] [TRT] Tactic: 0x0000000000000007 Time: 9.25401 [02/13/2023-19:58:40] [V] [TRT] Tactic: 0x0000000000000008 Time: 8.07964 [02/13/2023-19:58:40] [V] [TRT] Tactic: 0x0000000000000009 Time: 7.61742 [02/13/2023-19:58:40] [V] [TRT] Tactic: 0x000000000000001c Time: 0.409632 [02/13/2023-19:58:40] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.409632 [02/13/2023-19:58:40] [V] [TRT] --------------- Timing Runner: PWN(Clip_352) (PointWise) [02/13/2023-19:58:40] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:58:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:58:40] [V] [TRT] *************** Autotuning format combination: Float(3686400,1:4,2560,1) -> Float(3686400,1:4,2560,1) *************** [02/13/2023-19:58:40] [V] [TRT] --------------- Timing Runner: PWN(Clip_352) (PointWiseV2) [02/13/2023-19:58:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 6.72381 [02/13/2023-19:58:41] [V] [TRT] Tactic: 0x0000000000000001 Time: 8.15657 [02/13/2023-19:58:41] [V] [TRT] Tactic: 0x0000000000000002 Time: 7.88659 [02/13/2023-19:58:41] [V] [TRT] Tactic: 0x0000000000000003 Time: 10.645 [02/13/2023-19:58:42] [V] [TRT] Tactic: 0x0000000000000004 Time: 10.5046 [02/13/2023-19:58:42] [V] [TRT] Tactic: 0x0000000000000005 Time: 7.8014 [02/13/2023-19:58:43] [V] [TRT] Tactic: 0x0000000000000006 Time: 16.0388 [02/13/2023-19:58:43] [V] [TRT] Tactic: 0x0000000000000007 Time: 13.7982 [02/13/2023-19:58:44] [V] [TRT] Tactic: 0x0000000000000008 Time: 12.2079 [02/13/2023-19:58:44] [V] [TRT] Tactic: 0x0000000000000009 Time: 12.7035 [02/13/2023-19:58:45] [V] [TRT] Tactic: 0x000000000000000a Time: 6.62009 [02/13/2023-19:58:45] [V] [TRT] Tactic: 0x000000000000000b Time: 7.72953 [02/13/2023-19:58:45] [V] [TRT] Tactic: 0x000000000000000c Time: 7.28743 [02/13/2023-19:58:46] [V] [TRT] Tactic: 0x000000000000000d Time: 9.63698 [02/13/2023-19:58:46] [V] [TRT] Tactic: 0x000000000000000e Time: 9.7984 [02/13/2023-19:58:47] [V] [TRT] Tactic: 0x000000000000000f Time: 7.36347 [02/13/2023-19:58:47] [V] [TRT] Tactic: 0x0000000000000010 Time: 13.7519 [02/13/2023-19:58:48] [V] [TRT] Tactic: 0x0000000000000011 Time: 12.8092 [02/13/2023-19:58:48] [V] [TRT] Tactic: 0x0000000000000012 Time: 10.5599 [02/13/2023-19:58:48] [V] [TRT] Tactic: 0x0000000000000013 Time: 9.06858 [02/13/2023-19:58:49] [V] [TRT] Tactic: 0x0000000000000014 Time: 6.1672 [02/13/2023-19:58:49] [V] [TRT] Tactic: 0x0000000000000015 Time: 7.77288 [02/13/2023-19:58:50] [V] [TRT] Tactic: 0x0000000000000016 Time: 9.93593 [02/13/2023-19:58:50] [V] [TRT] Tactic: 0x0000000000000017 Time: 14.429 [02/13/2023-19:58:50] [V] [TRT] Tactic: 0x000000000000001c Time: 0.664133 [02/13/2023-19:58:51] [V] [TRT] Tactic: 0x000000000000001d Time: 0.753093 [02/13/2023-19:58:51] [V] [TRT] Tactic: 0x000000000000001e Time: 0.844393 [02/13/2023-19:58:51] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.664133 [02/13/2023-19:58:51] [V] [TRT] --------------- Timing Runner: PWN(Clip_352) (PointWise) [02/13/2023-19:58:51] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:58:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [02/13/2023-19:58:51] [V] [TRT] *************** Autotuning format combination: Float(3686400,3686400:32,2560,1) -> Float(3686400,3686400:32,2560,1) *************** [02/13/2023-19:58:51] [V] [TRT] --------------- Timing Runner: PWN(Clip_352) (PointWiseV2) [02/13/2023-19:58:52] [V] [TRT] Tactic: 0x0000000000000018 Time: 5.94638 [02/13/2023-19:58:52] [V] [TRT] Tactic: 0x0000000000000019 Time: 6.52354 [02/13/2023-19:58:53] [V] [TRT] Tactic: 0x000000000000001a Time: 5.89532 [02/13/2023-19:58:53] [V] [TRT] Tactic: 0x000000000000001b Time: 5.71249 [02/13/2023-19:58:54] [V] [TRT] Tactic: 0x000000000000001f Time: 5.97941 [02/13/2023-19:58:54] [V] [TRT] Fastest Tactic: 0x000000000000001b Time: 5.71249 [02/13/2023-19:58:54] [V] [TRT] --------------- Timing Runner: PWN(Clip_352) (PointWise) [02/13/2023-19:58:54] [V] [TRT] PointWise has no valid tactics for this config, skipping [02/13/2023-19:58:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001b [02/13/2023-19:58:54] [V] [TRT] *************** Autotuning format combination: Float(1:4,3686400,2560,1) -> Float(1:4,3686400,2560,1) *************** [02/13/2023-19:58:54] [V] [TRT] --------------- Timing Runner: PWN(Clip_352) (PointWiseV2) [02/13/2023-19:58:54] [V] [TRT] Tactic: 0x0000000000000000 Time: 6.7276 [02/13/2023-19:58:54] [V] [TRT] Tactic: 0x0000000000000001 Time: 8.15699 [02/13/2023-19:58:54] [V] [TRT] Tactic: 0x0000000000000002 Time: 7.88997 [02/13/2023-19:58:54] [V] [TRT] Tactic: 0x0000000000000003 Time: 10.6411 [02/13/2023-19:58:55] [V] [TRT] Tactic: 0x0000000000000004 Time: 10.5051 [02/13/2023-19:58:55] [V] [TRT] Tactic: 0x0000000000000005 Time: 7.80043 [02/13/2023-19:58:55] [V] [TRT] Tactic: 0x0000000000000006 Time: 16.0395 [02/13/2023-19:58:55] [V] [TRT] Tactic: 0x0000000000000007 Time: 13.7983 [02/13/2023-19:58:55] [V] [TRT] Tactic: 0x0000000000000008 Time: 12.2059 [02/13/2023-19:58:56] [V] [TRT] Tactic: 0x0000000000000009 Time: 12.7101 [02/13/2023-19:58:56] [V] [TRT] Tactic: 0x000000000000000a Time: 6.63636 [02/13/2023-19:58:56] [V] [TRT] Tactic: 0x000000000000000b Time: 7.72864 [02/13/2023-19:58:56] [V] [TRT] Tactic: 0x000000000000000c Time: 7.29012 [02/13/2023-19:58:56] [V] [TRT] Tactic: 0x000000000000000d Time: 9.63805 [02/13/2023-19:58:56] [V] [TRT] Tactic: 0x000000000000000e Time: 9.80587 [02/13/2023-19:58:56] [V] [TRT] Tactic: 0x000000000000000f Time: 7.37591 [02/13/2023-19:58:57] [V] [TRT] Tactic: 0x0000000000000010 Time: 13.7619 [02/13/2023-19:58:57] [V] [TRT] Tactic: 0x0000000000000011 Time: 12.8169 [02/13/2023-19:58:57] [V] [TRT] Tactic: 0x0000000000000012 Time: 10.6126 [02/13/2023-19:58:57] [V] [TRT] Tactic: 0x0000000000000013 Time: 9.1842 [02/13/2023-19:58:57] [V] [TRT] Tactic: 0x0000000000000014 Time: 6.21243 [02/13/2023-19:58:57] [V] [TRT] Tactic: 0x0000000000000015 Time: 7.7772 [02/13/2023-19:58:57] [V] [TRT] Tactic: 0x0000000000000016 Time: 10.0315 [02/13/2023-19:58:58] [V] [TRT] Tactic: 0x0000000000000017 Time: 14.467 [02/13/2023-19:58:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.884485 [02/13/2023-19:58:58] [V] [TRT] Tactic: 0x000000000000001d Time: 0.680608 [02/13/2023-19:58:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.854766 [02/13/2023-19:58:58] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.680608 [02/13/2023-19:58:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to AveragePool_171 (604) from Float(393984,2304,64,1) to Float(99072,1:4,2752,43) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(PWN(HardSigmoid_150), Mul_151) (952) from Float(552960,576,32,1) to Float(138240,1:4,7680,240) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to Conv_153 + Relu_154 (582) from Float(240,1:4,240,240) to Float(960,1,1,1) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(PWN(HardSigmoid_156), Mul_157) (585) from Float(960,1,1,1) to Float(960,1,960,960) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 1 to PWN(PWN(HardSigmoid_156), Mul_157) (581) from Float(138240,1:4,7680,240) to Float(552960,1,30720,960) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to Conv_158 + Add_159 (587) from Float(552960,1,30720,960) to Float(138240,1:4,7680,240) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 1 to Conv_158 + Add_159 (573) from Float(92160,576,32,1) to Float(23040,1:4,1280,40) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to Conv_166 (598) from Float(240,1:4,240,240) to Float(960,1,1,1) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(PWN(Sigmoid_167), Mul_168) (599) from Float(128,1,1,1) to Float(128,1,128,128) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 1 to PWN(PWN(Sigmoid_167), Mul_168) (597) from Float(18432,1:4,1024,32) to Float(73728,1,4096,128) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to Expand_174 (608) from Float(73728,576,32,1) to Float(18432,1:4,1024,32) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to Conv_176 (609) from Float(18432,1:4,1024,32) to Float(73728,1,4096,128) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to PWN(Sigmoid_177) (611) from Float(73728,1,4096,128) to Float(18432,1:4,1024,32) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)) (r4o) from Float(9216,1:4,512,16) to Float(36864,576,32,1) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to Conv_200 + Relu_201 (640) from Float(46080,1:4,1280,20) to Float(184320,1,5120,80) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to Expand_204 (644) from Float(184320,2304,64,1) to Float(46080,1:4,1280,20) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to Conv_206 (645) from Float(46080,1:4,1280,20) to Float(184320,1,5120,80) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to PWN(Sigmoid_207) (647) from Float(184320,1,5120,80) to Float(46080,1:4,1280,20) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to Conv_211 (651) from Float(46080,1:4,1280,20) to Float(184320,1,5120,80) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) (652) from Float(92160,1,2560,40) to Float(23040,1:4,640,10) [02/13/2023-19:58:58] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) (r3o) from Float(23040,1:4,640,10) to Float(92160,2304,64,1) [02/13/2023-19:58:58] [V] [TRT] Formats and tactics selection completed in 534.275 seconds. [02/13/2023-19:58:58] [V] [TRT] After reformat layers: 215 layers [02/13/2023-19:58:58] [V] [TRT] Pre-optimized block assignment. [02/13/2023-19:58:58] [V] [TRT] Block size 1769472 [02/13/2023-19:58:58] [V] [TRT] Block size 1769472 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 9437184 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 884736 [02/13/2023-19:58:58] [V] [TRT] Block size 2654208 [02/13/2023-19:58:58] [V] [TRT] Block size 2654208 [02/13/2023-19:58:58] [V] [TRT] Block size 884736 [02/13/2023-19:58:58] [V] [TRT] Block size 2654208 [02/13/2023-19:58:58] [V] [TRT] Block size 663552 [02/13/2023-19:58:58] [V] [TRT] Block size 512 [02/13/2023-19:58:58] [V] [TRT] Block size 512 [02/13/2023-19:58:58] [V] [TRT] Block size 512 [02/13/2023-19:58:58] [V] [TRT] Block size 663552 [02/13/2023-19:58:58] [V] [TRT] Block size 368640 [02/13/2023-19:58:58] [V] [TRT] Block size 1105920 [02/13/2023-19:58:58] [V] [TRT] Block size 1105920 [02/13/2023-19:58:58] [V] [TRT] Block size 512 [02/13/2023-19:58:58] [V] [TRT] Block size 512 [02/13/2023-19:58:58] [V] [TRT] Block size 512 [02/13/2023-19:58:58] [V] [TRT] Block size 1105920 [02/13/2023-19:58:58] [V] [TRT] Block size 368640 [02/13/2023-19:58:58] [V] [TRT] Block size 1105920 [02/13/2023-19:58:58] [V] [TRT] Block size 1105920 [02/13/2023-19:58:58] [V] [TRT] Block size 512 [02/13/2023-19:58:58] [V] [TRT] Block size 512 [02/13/2023-19:58:58] [V] [TRT] Block size 512 [02/13/2023-19:58:58] [V] [TRT] Block size 1105920 [02/13/2023-19:58:58] [V] [TRT] Block size 368640 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 552960 [02/13/2023-19:58:58] [V] [TRT] Block size 552960 [02/13/2023-19:58:58] [V] [TRT] Block size 184320 [02/13/2023-19:58:58] [V] [TRT] Block size 460800 [02/13/2023-19:58:58] [V] [TRT] Block size 460800 [02/13/2023-19:58:58] [V] [TRT] Block size 460800 [02/13/2023-19:58:58] [V] [TRT] Block size 460800 [02/13/2023-19:58:58] [V] [TRT] Block size 184320 [02/13/2023-19:58:58] [V] [TRT] Block size 423936 [02/13/2023-19:58:58] [V] [TRT] Block size 423936 [02/13/2023-19:58:58] [V] [TRT] Block size 423936 [02/13/2023-19:58:58] [V] [TRT] Block size 423936 [02/13/2023-19:58:58] [V] [TRT] Block size 184320 [02/13/2023-19:58:58] [V] [TRT] Block size 423936 [02/13/2023-19:58:58] [V] [TRT] Block size 423936 [02/13/2023-19:58:58] [V] [TRT] Block size 423936 [02/13/2023-19:58:58] [V] [TRT] Block size 423936 [02/13/2023-19:58:58] [V] [TRT] Block size 184320 [02/13/2023-19:58:58] [V] [TRT] Block size 1105920 [02/13/2023-19:58:58] [V] [TRT] Block size 1105920 [02/13/2023-19:58:58] [V] [TRT] Block size 1105920 [02/13/2023-19:58:58] [V] [TRT] Block size 1105920 [02/13/2023-19:58:58] [V] [TRT] Block size 2048 [02/13/2023-19:58:58] [V] [TRT] Block size 512 [02/13/2023-19:58:58] [V] [TRT] Block size 2048 [02/13/2023-19:58:58] [V] [TRT] Block size 1105920 [02/13/2023-19:58:58] [V] [TRT] Block size 258048 [02/13/2023-19:58:58] [V] [TRT] Block size 1548288 [02/13/2023-19:58:58] [V] [TRT] Block size 1548288 [02/13/2023-19:58:58] [V] [TRT] Block size 1548288 [02/13/2023-19:58:58] [V] [TRT] Block size 1548288 [02/13/2023-19:58:58] [V] [TRT] Block size 3072 [02/13/2023-19:58:58] [V] [TRT] Block size 1024 [02/13/2023-19:58:58] [V] [TRT] Block size 3072 [02/13/2023-19:58:58] [V] [TRT] Block size 1548288 [02/13/2023-19:58:58] [V] [TRT] Block size 258048 [02/13/2023-19:58:58] [V] [TRT] Block size 1548288 [02/13/2023-19:58:58] [V] [TRT] Block size 1548288 [02/13/2023-19:58:58] [V] [TRT] Block size 1548288 [02/13/2023-19:58:58] [V] [TRT] Block size 1548288 [02/13/2023-19:58:58] [V] [TRT] Block size 3072 [02/13/2023-19:58:58] [V] [TRT] Block size 1024 [02/13/2023-19:58:58] [V] [TRT] Block size 3072 [02/13/2023-19:58:58] [V] [TRT] Block size 1548288 [02/13/2023-19:58:58] [V] [TRT] Block size 368640 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 4096 [02/13/2023-19:58:58] [V] [TRT] Block size 1024 [02/13/2023-19:58:58] [V] [TRT] Block size 4096 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 368640 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 4096 [02/13/2023-19:58:58] [V] [TRT] Block size 1024 [02/13/2023-19:58:58] [V] [TRT] Block size 4096 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 368640 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 294912 [02/13/2023-19:58:58] [V] [TRT] Block size 4096 [02/13/2023-19:58:58] [V] [TRT] Block size 512 [02/13/2023-19:58:58] [V] [TRT] Block size 294912 [02/13/2023-19:58:58] [V] [TRT] Block size 294912 [02/13/2023-19:58:58] [V] [TRT] Block size 294912 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 294912 [02/13/2023-19:58:58] [V] [TRT] Block size 147456 [02/13/2023-19:58:58] [V] [TRT] Block size 294912 [02/13/2023-19:58:58] [V] [TRT] Block size 1179648 [02/13/2023-19:58:58] [V] [TRT] Block size 1585152 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 737280 [02/13/2023-19:58:58] [V] [TRT] Block size 737280 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 737280 [02/13/2023-19:58:58] [V] [TRT] Block size 368640 [02/13/2023-19:58:58] [V] [TRT] Block size 737280 [02/13/2023-19:58:58] [V] [TRT] Block size 2949120 [02/13/2023-19:58:58] [V] [TRT] Block size 3944448 [02/13/2023-19:58:58] [V] [TRT] Block size 1474560 [02/13/2023-19:58:58] [V] [TRT] Block size 1474560 [02/13/2023-19:58:58] [V] [TRT] Block size 1474560 [02/13/2023-19:58:58] [V] [TRT] Block size 1474560 [02/13/2023-19:58:58] [V] [TRT] Block size 1474560 [02/13/2023-19:58:58] [V] [TRT] Block size 737280 [02/13/2023-19:58:58] [V] [TRT] Block size 1474560 [02/13/2023-19:58:58] [V] [TRT] Block size 5898240 [02/13/2023-19:58:58] [V] [TRT] Block size 8699904 [02/13/2023-19:58:58] [V] [TRT] Block size 4718592 [02/13/2023-19:58:58] [V] [TRT] Block size 4718592 [02/13/2023-19:58:58] [V] [TRT] Block size 4718592 [02/13/2023-19:58:58] [V] [TRT] Block size 4718592 [02/13/2023-19:58:58] [V] [TRT] Block size 4718592 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 4718592 [02/13/2023-19:58:58] [V] [TRT] Block size 18874368 [02/13/2023-19:58:58] [V] [TRT] Block size 20643840 [02/13/2023-19:58:58] [V] [TRT] Block size 9437184 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 14745600 [02/13/2023-19:58:58] [V] [TRT] Block size 58982400 [02/13/2023-19:58:58] [V] [TRT] Block size 589824 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 14155776 [02/13/2023-19:58:58] [V] [TRT] Block size 9437184 [02/13/2023-19:58:58] [V] [TRT] Block size 9437184 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 58982400 [02/13/2023-19:58:58] [V] [TRT] Block size 58982400 [02/13/2023-19:58:58] [V] [TRT] Block size 58982400 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 27648 [02/13/2023-19:58:58] [V] [TRT] Block size 2211840 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 368640 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 147456 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 294912 [02/13/2023-19:58:58] [V] [TRT] Block size 147456 [02/13/2023-19:58:58] [V] [TRT] Block size 737280 [02/13/2023-19:58:58] [V] [TRT] Block size 368640 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 737280 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 368640 [02/13/2023-19:58:58] [V] [TRT] Block size 10485760000 [02/13/2023-19:58:58] [V] [TRT] Total Activation Memory: 11026776636 [02/13/2023-19:58:58] [I] [TRT] Detected 5 inputs and 6 output network tensors. [02/13/2023-19:58:58] [V] [TRT] Conv_8 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:58:58] [V] [TRT] Conv_13 + Add_14 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:58:58] [V] [TRT] Conv_15 + Relu_16 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:58:58] [V] [TRT] Conv_19 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:58:58] [V] [TRT] Conv_20 + Relu_21 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:58:58] [V] [TRT] Conv_24 + Add_25 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:58:58] [V] [TRT] Conv_26 + Relu_27 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 [02/13/2023-19:58:58] [V] [TRT] Conv_31 + Relu_32 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_33 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_37 + Relu_38 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:58:58] [V] [TRT] GlobalAveragePool_41 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Average_FastDiv Tactic: 0x933eceba7b866d59 [02/13/2023-19:58:58] [V] [TRT] Conv_42 + Relu_43 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_44 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_47 + Add_48 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:58:58] [V] [TRT] Conv_49 + Relu_50 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a [02/13/2023-19:58:58] [V] [TRT] GlobalAveragePool_53 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Average_FastDiv Tactic: 0x933eceba7b866d59 [02/13/2023-19:58:58] [V] [TRT] Conv_54 + Relu_55 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_56 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_59 + Add_60 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5d4d781b2e89fd83 [02/13/2023-19:58:58] [V] [TRT] Conv_61 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 [02/13/2023-19:58:58] [V] [TRT] Conv_67 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:58:58] [V] [TRT] Conv_68 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:58:58] [V] [TRT] Conv_74 + Add_75 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:58:58] [V] [TRT] Conv_76 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:58:58] [V] [TRT] Conv_82 + Add_83 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:58:58] [V] [TRT] Conv_84 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:58:58] [V] [TRT] Conv_90 + Add_91 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x09aeee2f1beac383 [02/13/2023-19:58:58] [V] [TRT] Conv_92 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:58:58] [V] [TRT] Conv_99 + Relu_100 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_101 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_104 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:58:58] [V] [TRT] Conv_105 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:58:58] [V] [TRT] Conv_112 + Relu_113 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_114 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_117 + Add_118 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5f5015dbf902f0a3 [02/13/2023-19:58:58] [V] [TRT] Conv_119 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:58:58] [V] [TRT] Conv_126 + Relu_127 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_128 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_131 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:58:58] [V] [TRT] Conv_132 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:58:58] [V] [TRT] GlobalAveragePool_138 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Average_FastDiv Tactic: 0x933eceba7b866d59 [02/13/2023-19:58:58] [V] [TRT] Conv_139 + Relu_140 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_141 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_144 + Add_145 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1016909b1fd6ff2f [02/13/2023-19:58:58] [V] [TRT] Conv_146 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b [02/13/2023-19:58:58] [V] [TRT] GlobalAveragePool_152 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Average_FastDiv_CAlign4 Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:58:58] [V] [TRT] Conv_153 + Relu_154 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_155 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: 0xaa0953b1a73b0b9b [02/13/2023-19:58:58] [V] [TRT] Conv_158 + Add_159 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:58:58] [V] [TRT] Conv_160 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b [02/13/2023-19:58:58] [V] [TRT] Conv_163 + Relu_164 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x4aa9c14ea2943ef0 [02/13/2023-19:58:58] [V] [TRT] GlobalAveragePool_165 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Average_FastDiv_CAlign4 Tactic: 0xfab3e2ee1c085a9a [02/13/2023-19:58:58] [V] [TRT] Conv_176 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xd4428a7355769d7d [02/13/2023-19:58:58] [V] [TRT] Conv_181 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x818413b69874bb35 [02/13/2023-19:58:58] [V] [TRT] Conv_200 + Relu_201 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:58:58] [V] [TRT] Conv_206 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x21246c8544eff903 [02/13/2023-19:58:58] [V] [TRT] Conv_211 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xa9a06d0633580c0c [02/13/2023-19:58:58] [V] [TRT] Conv_230 + Relu_231 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:58:58] [V] [TRT] Conv_236 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:58:58] [V] [TRT] Conv_241 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:58:58] [V] [TRT] Conv_260 + Relu_261 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:58:58] [V] [TRT] Conv_266 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:58:58] [V] [TRT] Conv_271 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:58:58] [V] [TRT] Conv_290 + Relu_291 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:58:58] [V] [TRT] Conv_292 + Relu_293 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a [02/13/2023-19:58:58] [V] [TRT] Conv_312 + Relu_313 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:58:58] [V] [TRT] Conv_314 + Relu_315 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Network Input src Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 390 + (Unnamed Layer* 2) [Shuffle] Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 392 + (Unnamed Layer* 5) [Shuffle] Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Resize_3 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: ReduceMean_296 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: AveragePool_169 Host Persistent: 48 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: ReduceMean_298 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: src copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 755 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: AveragePool_170 Host Persistent: 48 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 389 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 757 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(Sub_5, Div_7) Host Persistent: 476 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: AveragePool_171 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to AveragePool_171 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_301 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Mul_307 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_8 Host Persistent: 1664 Device Persistent: 221696 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_308 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(Mul_309, Sub_310) Host Persistent: 340 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_9), Mul_10) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_11 + Relu_12 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_13 + Add_14 Host Persistent: 3200 Device Persistent: 221696 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_15 + Relu_16 Host Persistent: 3200 Device Persistent: 221696 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_17 + Relu_18 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_19 Host Persistent: 3200 Device Persistent: 55808 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_20 + Relu_21 Host Persistent: 1664 Device Persistent: 55808 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_22 + Relu_23 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_24 + Add_25 Host Persistent: 3200 Device Persistent: 55808 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_26 + Relu_27 Host Persistent: 1664 Device Persistent: 55808 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_28 + Relu_29 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: GlobalAveragePool_30 Host Persistent: 48 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_31 + Relu_32 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_33 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_34), Mul_35) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_36 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_37 + Relu_38 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_39 + Relu_40 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: GlobalAveragePool_41 Host Persistent: 1088 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_42 + Relu_43 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_44 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_45), Mul_46) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_47 + Add_48 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_49 + Relu_50 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_51 + Relu_52 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: GlobalAveragePool_53 Host Persistent: 1088 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_54 + Relu_55 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_56 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_57), Mul_58) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_59 + Add_60 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_61 Host Persistent: 3200 Device Persistent: 14336 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_62), Mul_63) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_64 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_65), Mul_66) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_67 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_68 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_69), Mul_70) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_71 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_72), Mul_73) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_74 + Add_75 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_76 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_77), Mul_78) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_79 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_80), Mul_81) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_82 + Add_83 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_84 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_85), Mul_86) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_87 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_88), Mul_89) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_90 + Add_91 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_92 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_93), Mul_94) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_95 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_96), Mul_97) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: GlobalAveragePool_98 Host Persistent: 48 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_99 + Relu_100 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_101 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_102), Mul_103) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_104 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_105 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_106), Mul_107) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_108 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_109), Mul_110) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: GlobalAveragePool_111 Host Persistent: 48 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_112 + Relu_113 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_114 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_115), Mul_116) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_117 + Add_118 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_119 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_120), Mul_121) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_122 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_123), Mul_124) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: GlobalAveragePool_125 Host Persistent: 48 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_126 + Relu_127 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_128 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_129), Mul_130) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_131 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_132 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_133), Mul_134) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_135 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_136), Mul_137) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: GlobalAveragePool_138 Host Persistent: 1088 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_139 + Relu_140 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_141 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_142), Mul_143) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_144 + Add_145 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_146 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_147), Mul_148) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_149 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to PWN(PWN(HardSigmoid_150), Mul_151) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_150), Mul_151) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: GlobalAveragePool_152 Host Persistent: 1088 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to Conv_153 + Relu_154 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_153 + Relu_154 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_155 Host Persistent: 2048 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to PWN(PWN(HardSigmoid_156), Mul_157) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 1 to PWN(PWN(HardSigmoid_156), Mul_157) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_156), Mul_157) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to Conv_158 + Add_159 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 1 to Conv_158 + Add_159 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_158 + Add_159 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_160 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(HardSigmoid_161), Mul_162) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_163 + Relu_164 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: GlobalAveragePool_165 Host Persistent: 1088 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to Conv_166 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_166 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to PWN(PWN(Sigmoid_167), Mul_168) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 1 to PWN(PWN(Sigmoid_167), Mul_168) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(Sigmoid_167), Mul_168) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Expand_174 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to Expand_174 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 606 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to Conv_176 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_176 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(Sigmoid_177) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to PWN(Sigmoid_177) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Mul_179 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 606 copy (1) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_181 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)) Host Persistent: 436 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 605 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: r4o copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Resize_190 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 628 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 464 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_200 + Relu_201 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to Conv_200 + Relu_201 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Expand_204 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to Expand_204 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 642 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to Conv_206 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_206 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(Sigmoid_207) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to PWN(Sigmoid_207) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Mul_209 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 642 copy (1) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to Conv_211 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_211 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) Host Persistent: 436 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 641 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: r3o copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Resize_220 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 664 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 420 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_230 + Relu_231 Host Persistent: 512 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Expand_234 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 678 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_236 Host Persistent: 512 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(Sigmoid_237) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Mul_239 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 678 copy (1) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_241 Host Persistent: 512 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(PWN(Tanh_242), Mul_246), PWN(PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245), Add_247)) Host Persistent: 436 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 677 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: r2o copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Resize_250 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 700 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 403 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_260 + Relu_261 Host Persistent: 512 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Expand_264 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 714 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_266 Host Persistent: 512 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(Sigmoid_267) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Mul_269 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 714 copy (1) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_271 Host Persistent: 512 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(PWN(PWN(Tanh_272), Mul_276), PWN(PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275), Add_277)) Host Persistent: 436 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 713 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: r1o copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Resize_280 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 736 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 389 copy (1) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_290 + Relu_291 Host Persistent: 512 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_292 + Relu_293 Host Persistent: 512 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_294 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 512 [02/13/2023-19:58:58] [V] [TRT] Layer: 753 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 754 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_302 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Mul_303 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_304 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(Mul_305, Sub_306) Host Persistent: 436 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: 765 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_312 + Relu_313 Host Persistent: 3200 Device Persistent: 885248 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_314 + Relu_315 Host Persistent: 3200 Device Persistent: 885248 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Conv_316 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 512 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(Mul_317, Sub_318) Host Persistent: 436 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Resize_332 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: Resize_346 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(Mul_347, Add_348) Host Persistent: 436 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(Add_350, PWN(Clip_351)) Host Persistent: 340 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [V] [TRT] Layer: PWN(Clip_352) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [02/13/2023-19:58:58] [I] [TRT] Total Host Persistent Memory: 162464 [02/13/2023-19:58:58] [I] [TRT] Total Device Persistent Memory: 2673152 [02/13/2023-19:58:58] [I] [TRT] Total Scratch Memory: 512 [02/13/2023-19:58:58] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 1 MiB, GPU 2219 MiB [02/13/2023-19:58:58] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 118.167ms to assign 18 blocks to 185 nodes requiring 258453512 bytes. [02/13/2023-19:58:58] [V] [TRT] Optimized block assignment. [02/13/2023-19:58:58] [V] [TRT] Block size 58982400 [02/13/2023-19:58:58] [V] [TRT] Block size 58982400 [02/13/2023-19:58:58] [V] [TRT] Block size 58982400 [02/13/2023-19:58:58] [V] [TRT] Block size 58982400 [02/13/2023-19:58:58] [V] [TRT] Block size 4718592 [02/13/2023-19:58:58] [V] [TRT] Block size 4718592 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 2359296 [02/13/2023-19:58:58] [V] [TRT] Block size 1769472 [02/13/2023-19:58:58] [V] [TRT] Block size 1585152 [02/13/2023-19:58:58] [V] [TRT] Block size 884736 [02/13/2023-19:58:58] [V] [TRT] Block size 884736 [02/13/2023-19:58:58] [V] [TRT] Block size 368640 [02/13/2023-19:58:58] [V] [TRT] Block size 368640 [02/13/2023-19:58:58] [V] [TRT] Block size 147456 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [V] [TRT] Block size 4 [02/13/2023-19:58:58] [I] [TRT] Total Activation Memory: 258453512 [02/13/2023-19:58:58] [V] [TRT] Using cublasLt as a tactic source [02/13/2023-19:58:58] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +1, GPU +5, now: CPU 1911, GPU 10820 (MiB) [02/13/2023-19:58:58] [V] [TRT] Using cuDNN as a tactic source [02/13/2023-19:58:58] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +10, now: CPU 1911, GPU 10830 (MiB) [02/13/2023-19:58:58] [V] [TRT] Engine generation completed in 535.751 seconds. [02/13/2023-19:58:58] [V] [TRT] Deleting timing cache: 1732 entries, served 2077 hits since creation. [02/13/2023-19:58:58] [V] [TRT] Engine Layer Information: Layer(NoOp): Reformatting CopyNode for Network Input src, Tactic: 0x0000000000000000, src[Float(1,3,1440,2560)] -> Reformatted src[Float(1,3,1440,2560)] Layer(Constant): 390 + (Unnamed Layer* 2) [Shuffle], Tactic: 0x0000000000000000, -> (Unnamed Layer* 2) [Shuffle]_output[Float(1,3,1,1)] Layer(Constant): 392 + (Unnamed Layer* 5) [Shuffle], Tactic: 0x0000000000000000, -> (Unnamed Layer* 5) [Shuffle]_output[Float(1,3,1,1)] Layer(Resize): Resize_3, Tactic: 0x0000000000000001, Reformatted src[Float(1,3,1440,2560)] -> 389[Float(1,3,288,512)] Layer(Reduce): ReduceMean_296, Tactic: 0x0000000000000008, Reformatted src[Float(1,3,1440,2560)] -> 755[Float(1,1,1440,2560)] Layer(CudnnPooling): AveragePool_169, Tactic: 0xffffffffffffffff, 389[Float(1,3,288,512)] -> 709[Float(1,3,144,256)] Layer(Reduce): ReduceMean_298, Tactic: 0x0000000000000007, 389[Float(1,3,288,512)] -> 757[Float(1,1,288,512)] Layer(Reformat): src copy, Tactic: 0x00000000000003e8, Reformatted src[Float(1,3,1440,2560)] -> 756[Float(1,3,1440,2560)] Layer(Reformat): 755 copy, Tactic: 0x0000000000000000, 755[Float(1,1,1440,2560)] -> 756[Float(1,1,1440,2560)] Layer(CudnnPooling): AveragePool_170, Tactic: 0xffffffffffffffff, 709[Float(1,3,144,256)] -> 673[Float(1,3,72,128)] Layer(Reformat): 389 copy, Tactic: 0x00000000000003e8, 389[Float(1,3,288,512)] -> 758[Float(1,3,288,512)] Layer(Reformat): 757 copy, Tactic: 0x0000000000000000, 757[Float(1,1,288,512)] -> 758[Float(1,1,288,512)] Layer(PointWiseV2): PWN(Sub_5, Div_7), Tactic: 0x0000000000000007, 389[Float(1,3,288,512)], (Unnamed Layer* 2) [Shuffle]_output[Float(1,3,1,1)], (Unnamed Layer* 5) [Shuffle]_output[Float(1,3,1,1)] -> 393[Float(1,3,288,512)] Layer(TiledPooling): AveragePool_171, Tactic: 0x0000000000710308, 673[Float(1,3,72,128)] -> Reformatted Output Tensor 0 to AveragePool_171[Float(1,3,36,64)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to AveragePool_171, Tactic: 0x0000000000000000, Reformatted Output Tensor 0 to AveragePool_171[Float(1,3,36,64)] -> 637[Float(1,3,36,64)] Layer(CudnnConvolution): Conv_301, Tactic: 0x0000000000000072, 758[Float(1,4,288,512)] -> 760[Float(1,4,288,512)] Layer(ElementWise): Mul_307, Tactic: 0x0000000000000001, 758[Float(1,4,288,512)], 758[Float(1,4,288,512)] -> 766[Float(1,4,288,512)] Layer(CaskConvolution): Conv_8, Tactic: 0xa8609adc4e0ceb90, 393[Float(1,3,288,512)] -> 823[Float(1,16,144,256)] Layer(CudnnConvolution): Conv_308, Tactic: 0x0000000000000072, 766[Float(1,4,288,512)] -> 767[Float(1,4,288,512)] Layer(PointWiseV2): PWN(Mul_309, Sub_310), Tactic: 0x0000000000000008, 760[Float(1,4,288,512)], 767[Float(1,4,288,512)] -> 770[Float(1,4,288,512)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_9), Mul_10), Tactic: 0x0000000000000002, 823[Float(1,16,144,256)] -> 397[Float(1,16,144,256)] Layer(CudnnConvolution): Conv_11 + Relu_12, Tactic: 0x0000000000000071, 397[Float(1,16,144,256)] -> 400[Float(1,16,144,256)] Layer(CaskConvolution): Conv_13 + Add_14, Tactic: 0x9808072e706def96, 400[Float(1,16,144,256)], 397[Float(1,16,144,256)] -> 403[Float(1,16,144,256)] Layer(CaskConvolution): Conv_15 + Relu_16, Tactic: 0xc3cf6e1d1c6aff27, 403[Float(1,16,144,256)] -> 406[Float(1,64,144,256)] Layer(CudaDepthwiseConvolution): Conv_17 + Relu_18, Tactic: 0xffffffffffffffff, 406[Float(1,64,144,256)] -> 409[Float(1,64,72,128)] Layer(CaskConvolution): Conv_19, Tactic: 0x9808072e706def96, 409[Float(1,64,72,128)] -> 838[Float(1,24,72,128)] Layer(CaskConvolution): Conv_20 + Relu_21, Tactic: 0xa8609adc4e0ceb90, 838[Float(1,24,72,128)] -> 414[Float(1,72,72,128)] Layer(CudaDepthwiseConvolution): Conv_22 + Relu_23, Tactic: 0xffffffffffffffff, 414[Float(1,72,72,128)] -> 417[Float(1,72,72,128)] Layer(CaskConvolution): Conv_24 + Add_25, Tactic: 0x9808072e706def96, 417[Float(1,72,72,128)], 838[Float(1,24,72,128)] -> 420[Float(1,24,72,128)] Layer(CaskConvolution): Conv_26 + Relu_27, Tactic: 0xa8609adc4e0ceb90, 420[Float(1,24,72,128)] -> 423[Float(1,72,72,128)] Layer(CudaDepthwiseConvolution): Conv_28 + Relu_29, Tactic: 0xffffffffffffffff, 423[Float(1,72,72,128)] -> 426[Float(1,72,36,64)] Layer(CudnnPooling): GlobalAveragePool_30, Tactic: 0xffffffffffffffff, 426[Float(1,72,36,64)] -> 427[Float(1,72,1,1)] Layer(CaskConvolution): Conv_31 + Relu_32, Tactic: 0xaa0953b1a73b0b9b, 427[Float(1,72,1,1)] -> 429[Float(1,24,1,1)] Layer(CaskConvolution): Conv_33, Tactic: 0xaa0953b1a73b0b9b, 429[Float(1,24,1,1)] -> 430[Float(1,72,1,1)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_34), Mul_35), Tactic: 0x0000000000000002, 430[Float(1,72,1,1)], 426[Float(1,72,36,64)] -> 432[Float(1,72,36,64)] Layer(CudnnConvolution): Conv_36, Tactic: 0x0000000000000039, 432[Float(1,72,36,64)] -> 856[Float(1,40,36,64)] Layer(CaskConvolution): Conv_37 + Relu_38, Tactic: 0x1fc87d7eb370bb7a, 856[Float(1,40,36,64)] -> 437[Float(1,120,36,64)] Layer(CudaDepthwiseConvolution): Conv_39 + Relu_40, Tactic: 0xffffffffffffffff, 437[Float(1,120,36,64)] -> 440[Float(1,120,36,64)] Layer(CaskPooling): GlobalAveragePool_41, Tactic: 0x933eceba7b866d59, 440[Float(1,120,36,64)] -> 441[Float(1,120,1,1)] Layer(CaskConvolution): Conv_42 + Relu_43, Tactic: 0xaa0953b1a73b0b9b, 441[Float(1,120,1,1)] -> 443[Float(1,32,1,1)] Layer(CaskConvolution): Conv_44, Tactic: 0xaa0953b1a73b0b9b, 443[Float(1,32,1,1)] -> 444[Float(1,120,1,1)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_45), Mul_46), Tactic: 0x0000000000000002, 444[Float(1,120,1,1)], 440[Float(1,120,36,64)] -> 446[Float(1,120,36,64)] Layer(CaskConvolution): Conv_47 + Add_48, Tactic: 0x5d4d781b2e89fd83, 446[Float(1,120,36,64)], 856[Float(1,40,36,64)] -> 449[Float(1,40,36,64)] Layer(CaskConvolution): Conv_49 + Relu_50, Tactic: 0x1fc87d7eb370bb7a, 449[Float(1,40,36,64)] -> 452[Float(1,120,36,64)] Layer(CudaDepthwiseConvolution): Conv_51 + Relu_52, Tactic: 0xffffffffffffffff, 452[Float(1,120,36,64)] -> 455[Float(1,120,36,64)] Layer(CaskPooling): GlobalAveragePool_53, Tactic: 0x933eceba7b866d59, 455[Float(1,120,36,64)] -> 456[Float(1,120,1,1)] Layer(CaskConvolution): Conv_54 + Relu_55, Tactic: 0xaa0953b1a73b0b9b, 456[Float(1,120,1,1)] -> 458[Float(1,32,1,1)] Layer(CaskConvolution): Conv_56, Tactic: 0xaa0953b1a73b0b9b, 458[Float(1,32,1,1)] -> 459[Float(1,120,1,1)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_57), Mul_58), Tactic: 0x0000000000000002, 459[Float(1,120,1,1)], 455[Float(1,120,36,64)] -> 461[Float(1,120,36,64)] Layer(CaskConvolution): Conv_59 + Add_60, Tactic: 0x5d4d781b2e89fd83, 461[Float(1,120,36,64)], 449[Float(1,40,36,64)] -> 464[Float(1,40,36,64)] Layer(CaskConvolution): Conv_61, Tactic: 0xc3cf6e1d1c6aff27, 464[Float(1,40,36,64)] -> 877[Float(1,240,36,64)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_62), Mul_63), Tactic: 0x0000000000000003, 877[Float(1,240,36,64)] -> 468[Float(1,240,36,64)] Layer(CudaDepthwiseConvolution): Conv_64, Tactic: 0xffffffffffffffff, 468[Float(1,240,36,64)] -> 880[Float(1,240,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_65), Mul_66), Tactic: 0x0000000000000005, 880[Float(1,240,18,32)] -> 472[Float(1,240,18,32)] Layer(CaskConvolution): Conv_67, Tactic: 0x5f5015dbf902f0a3, 472[Float(1,240,18,32)] -> 883[Float(1,80,18,32)] Layer(CaskConvolution): Conv_68, Tactic: 0xa419b3b68f2da07b, 883[Float(1,80,18,32)] -> 886[Float(1,200,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_69), Mul_70), Tactic: 0x0000000000000009, 886[Float(1,200,18,32)] -> 478[Float(1,200,18,32)] Layer(CudaDepthwiseConvolution): Conv_71, Tactic: 0xffffffffffffffff, 478[Float(1,200,18,32)] -> 889[Float(1,200,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_72), Mul_73), Tactic: 0x0000000000000009, 889[Float(1,200,18,32)] -> 482[Float(1,200,18,32)] Layer(CaskConvolution): Conv_74 + Add_75, Tactic: 0x5f5015dbf902f0a3, 482[Float(1,200,18,32)], 883[Float(1,80,18,32)] -> 485[Float(1,80,18,32)] Layer(CaskConvolution): Conv_76, Tactic: 0x1016909b1fd6ff2f, 485[Float(1,80,18,32)] -> 895[Float(1,184,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_77), Mul_78), Tactic: 0x0000000000000009, 895[Float(1,184,18,32)] -> 489[Float(1,184,18,32)] Layer(CudaDepthwiseConvolution): Conv_79, Tactic: 0xffffffffffffffff, 489[Float(1,184,18,32)] -> 898[Float(1,184,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_80), Mul_81), Tactic: 0x0000000000000009, 898[Float(1,184,18,32)] -> 493[Float(1,184,18,32)] Layer(CaskConvolution): Conv_82 + Add_83, Tactic: 0x09aeee2f1beac383, 493[Float(1,184,18,32)], 485[Float(1,80,18,32)] -> 496[Float(1,80,18,32)] Layer(CaskConvolution): Conv_84, Tactic: 0x1016909b1fd6ff2f, 496[Float(1,80,18,32)] -> 904[Float(1,184,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_85), Mul_86), Tactic: 0x0000000000000009, 904[Float(1,184,18,32)] -> 500[Float(1,184,18,32)] Layer(CudaDepthwiseConvolution): Conv_87, Tactic: 0xffffffffffffffff, 500[Float(1,184,18,32)] -> 907[Float(1,184,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_88), Mul_89), Tactic: 0x0000000000000009, 907[Float(1,184,18,32)] -> 504[Float(1,184,18,32)] Layer(CaskConvolution): Conv_90 + Add_91, Tactic: 0x09aeee2f1beac383, 504[Float(1,184,18,32)], 496[Float(1,80,18,32)] -> 507[Float(1,80,18,32)] Layer(CaskConvolution): Conv_92, Tactic: 0xa419b3b68f2da07b, 507[Float(1,80,18,32)] -> 913[Float(1,480,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_93), Mul_94), Tactic: 0x0000000000000007, 913[Float(1,480,18,32)] -> 511[Float(1,480,18,32)] Layer(CudaDepthwiseConvolution): Conv_95, Tactic: 0xffffffffffffffff, 511[Float(1,480,18,32)] -> 916[Float(1,480,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_96), Mul_97), Tactic: 0x0000000000000007, 916[Float(1,480,18,32)] -> 515[Float(1,480,18,32)] Layer(CudnnPooling): GlobalAveragePool_98, Tactic: 0xffffffffffffffff, 515[Float(1,480,18,32)] -> 516[Float(1,480,1,1)] Layer(CaskConvolution): Conv_99 + Relu_100, Tactic: 0xaa0953b1a73b0b9b, 516[Float(1,480,1,1)] -> 518[Float(1,120,1,1)] Layer(CaskConvolution): Conv_101, Tactic: 0xaa0953b1a73b0b9b, 518[Float(1,120,1,1)] -> 519[Float(1,480,1,1)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_102), Mul_103), Tactic: 0x000000000000001c, 519[Float(1,480,1,1)], 515[Float(1,480,18,32)] -> 521[Float(1,480,18,32)] Layer(CaskConvolution): Conv_104, Tactic: 0x5f5015dbf902f0a3, 521[Float(1,480,18,32)] -> 919[Float(1,112,18,32)] Layer(CaskConvolution): Conv_105, Tactic: 0xa419b3b68f2da07b, 919[Float(1,112,18,32)] -> 922[Float(1,672,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_106), Mul_107), Tactic: 0x0000000000000008, 922[Float(1,672,18,32)] -> 527[Float(1,672,18,32)] Layer(CudaDepthwiseConvolution): Conv_108, Tactic: 0xffffffffffffffff, 527[Float(1,672,18,32)] -> 925[Float(1,672,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_109), Mul_110), Tactic: 0x0000000000000008, 925[Float(1,672,18,32)] -> 531[Float(1,672,18,32)] Layer(CudnnPooling): GlobalAveragePool_111, Tactic: 0xffffffffffffffff, 531[Float(1,672,18,32)] -> 532[Float(1,672,1,1)] Layer(CaskConvolution): Conv_112 + Relu_113, Tactic: 0xaa0953b1a73b0b9b, 532[Float(1,672,1,1)] -> 534[Float(1,168,1,1)] Layer(CaskConvolution): Conv_114, Tactic: 0xaa0953b1a73b0b9b, 534[Float(1,168,1,1)] -> 535[Float(1,672,1,1)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_115), Mul_116), Tactic: 0x000000000000001c, 535[Float(1,672,1,1)], 531[Float(1,672,18,32)] -> 537[Float(1,672,18,32)] Layer(CaskConvolution): Conv_117 + Add_118, Tactic: 0x5f5015dbf902f0a3, 537[Float(1,672,18,32)], 919[Float(1,112,18,32)] -> 540[Float(1,112,18,32)] Layer(CaskConvolution): Conv_119, Tactic: 0xa419b3b68f2da07b, 540[Float(1,112,18,32)] -> 931[Float(1,672,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_120), Mul_121), Tactic: 0x0000000000000008, 931[Float(1,672,18,32)] -> 544[Float(1,672,18,32)] Layer(CudnnConvolution): Conv_122, Tactic: 0x0000000000000071, 544[Float(1,672,18,32)] -> 934[Float(1,672,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_123), Mul_124), Tactic: 0x0000000000000008, 934[Float(1,672,18,32)] -> 548[Float(1,672,18,32)] Layer(CudnnPooling): GlobalAveragePool_125, Tactic: 0xffffffffffffffff, 548[Float(1,672,18,32)] -> 549[Float(1,672,1,1)] Layer(CaskConvolution): Conv_126 + Relu_127, Tactic: 0xaa0953b1a73b0b9b, 549[Float(1,672,1,1)] -> 551[Float(1,168,1,1)] Layer(CaskConvolution): Conv_128, Tactic: 0xaa0953b1a73b0b9b, 551[Float(1,168,1,1)] -> 552[Float(1,672,1,1)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_129), Mul_130), Tactic: 0x000000000000001c, 552[Float(1,672,1,1)], 548[Float(1,672,18,32)] -> 554[Float(1,672,18,32)] Layer(CaskConvolution): Conv_131, Tactic: 0x1016909b1fd6ff2f, 554[Float(1,672,18,32)] -> 937[Float(1,160,18,32)] Layer(CaskConvolution): Conv_132, Tactic: 0xa419b3b68f2da07b, 937[Float(1,160,18,32)] -> 940[Float(1,960,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_133), Mul_134), Tactic: 0x0000000000000005, 940[Float(1,960,18,32)] -> 560[Float(1,960,18,32)] Layer(CudnnConvolution): Conv_135, Tactic: 0x000000000000003a, 560[Float(1,960,18,32)] -> 943[Float(1,960,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_136), Mul_137), Tactic: 0x0000000000000005, 943[Float(1,960,18,32)] -> 564[Float(1,960,18,32)] Layer(CaskPooling): GlobalAveragePool_138, Tactic: 0x933eceba7b866d59, 564[Float(1,960,18,32)] -> 565[Float(1,960,1,1)] Layer(CaskConvolution): Conv_139 + Relu_140, Tactic: 0xaa0953b1a73b0b9b, 565[Float(1,960,1,1)] -> 567[Float(1,240,1,1)] Layer(CaskConvolution): Conv_141, Tactic: 0xaa0953b1a73b0b9b, 567[Float(1,240,1,1)] -> 568[Float(1,960,1,1)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_142), Mul_143), Tactic: 0x0000000000000000, 568[Float(1,960,1,1)], 564[Float(1,960,18,32)] -> 570[Float(1,960,18,32)] Layer(CaskConvolution): Conv_144 + Add_145, Tactic: 0x1016909b1fd6ff2f, 570[Float(1,960,18,32)], 937[Float(1,160,18,32)] -> 573[Float(1,160,18,32)] Layer(CaskConvolution): Conv_146, Tactic: 0xa419b3b68f2da07b, 573[Float(1,160,18,32)] -> 949[Float(1,960,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_147), Mul_148), Tactic: 0x0000000000000005, 949[Float(1,960,18,32)] -> 577[Float(1,960,18,32)] Layer(CudnnConvolution): Conv_149, Tactic: 0x000000000000003a, 577[Float(1,960,18,32)] -> 952[Float(1,960,18,32)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to PWN(PWN(HardSigmoid_150), Mul_151), Tactic: 0x00000000000003ea, 952[Float(1,960,18,32)] -> Reformatted Input Tensor 0 to PWN(PWN(HardSigmoid_150), Mul_151)[Float(1,960,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_150), Mul_151), Tactic: 0x0000000000000013, Reformatted Input Tensor 0 to PWN(PWN(HardSigmoid_150), Mul_151)[Float(1,960,18,32)] -> 581[Float(1,960,18,32)] Layer(CaskPooling): GlobalAveragePool_152, Tactic: 0xfab3e2ee1c085a9a, 581[Float(1,960,18,32)] -> 582[Float(1,960,1,1)] Layer(NoOp): Reformatting CopyNode for Input Tensor 0 to Conv_153 + Relu_154, Tactic: 0x0000000000000000, 582[Float(1,960,1,1)] -> Reformatted Input Tensor 0 to Conv_153 + Relu_154[Float(1,960,1,1)] Layer(CaskConvolution): Conv_153 + Relu_154, Tactic: 0xaa0953b1a73b0b9b, Reformatted Input Tensor 0 to Conv_153 + Relu_154[Float(1,960,1,1)] -> 584[Float(1,240,1,1)] Layer(CaskConvolution): Conv_155, Tactic: 0xaa0953b1a73b0b9b, 584[Float(1,240,1,1)] -> 585[Float(1,960,1,1)] Layer(NoOp): Reformatting CopyNode for Input Tensor 0 to PWN(PWN(HardSigmoid_156), Mul_157), Tactic: 0x0000000000000000, 585[Float(1,960,1,1)] -> Reformatted Input Tensor 0 to PWN(PWN(HardSigmoid_156), Mul_157)[Float(1,960,1,1)] Layer(NoOp): Reformatting CopyNode for Input Tensor 1 to PWN(PWN(HardSigmoid_156), Mul_157), Tactic: 0x0000000000000000, 581[Float(1,960,18,32)] -> Reformatted Input Tensor 1 to PWN(PWN(HardSigmoid_156), Mul_157)[Float(1,960,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_156), Mul_157), Tactic: 0x0000000000000008, Reformatted Input Tensor 0 to PWN(PWN(HardSigmoid_156), Mul_157)[Float(1,960,1,1)], Reformatted Input Tensor 1 to PWN(PWN(HardSigmoid_156), Mul_157)[Float(1,960,18,32)] -> 587[Float(1,960,18,32)] Layer(NoOp): Reformatting CopyNode for Input Tensor 0 to Conv_158 + Add_159, Tactic: 0x0000000000000000, 587[Float(1,960,18,32)] -> Reformatted Input Tensor 0 to Conv_158 + Add_159[Float(1,960,18,32)] Layer(Reformat): Reformatting CopyNode for Input Tensor 1 to Conv_158 + Add_159, Tactic: 0x00000000000003ea, 573[Float(1,160,18,32)] -> Reformatted Input Tensor 1 to Conv_158 + Add_159[Float(1,160,18,32)] Layer(CaskConvolution): Conv_158 + Add_159, Tactic: 0x4aa9c14ea2943ef0, Reformatted Input Tensor 0 to Conv_158 + Add_159[Float(1,960,18,32)], Reformatted Input Tensor 1 to Conv_158 + Add_159[Float(1,160,18,32)] -> 590[Float(1,160,18,32)] Layer(CaskConvolution): Conv_160, Tactic: 0x130df49cb195156b, 590[Float(1,160,18,32)] -> 958[Float(1,960,18,32)] Layer(PointWiseV2): PWN(PWN(HardSigmoid_161), Mul_162), Tactic: 0x0000000000000013, 958[Float(1,960,18,32)] -> 594[Float(1,960,18,32)] Layer(CaskConvolution): Conv_163 + Relu_164, Tactic: 0x4aa9c14ea2943ef0, 594[Float(1,960,18,32)] -> 597[Float(1,128,18,32)] Layer(CaskPooling): GlobalAveragePool_165, Tactic: 0xfab3e2ee1c085a9a, 594[Float(1,960,18,32)] -> 598[Float(1,960,1,1)] Layer(NoOp): Reformatting CopyNode for Input Tensor 0 to Conv_166, Tactic: 0x0000000000000000, 598[Float(1,960,1,1)] -> Reformatted Input Tensor 0 to Conv_166[Float(1,960,1,1)] Layer(CublasConvolution): Conv_166, Tactic: 0x0000000000000002, Reformatted Input Tensor 0 to Conv_166[Float(1,960,1,1)] -> 599[Float(1,128,1,1)] Layer(NoOp): Reformatting CopyNode for Input Tensor 0 to PWN(PWN(Sigmoid_167), Mul_168), Tactic: 0x0000000000000000, 599[Float(1,128,1,1)] -> Reformatted Input Tensor 0 to PWN(PWN(Sigmoid_167), Mul_168)[Float(1,128,1,1)] Layer(NoOp): Reformatting CopyNode for Input Tensor 1 to PWN(PWN(Sigmoid_167), Mul_168), Tactic: 0x0000000000000000, 597[Float(1,128,18,32)] -> Reformatted Input Tensor 1 to PWN(PWN(Sigmoid_167), Mul_168)[Float(1,128,18,32)] Layer(PointWiseV2): PWN(PWN(Sigmoid_167), Mul_168), Tactic: 0x0000000000000005, Reformatted Input Tensor 0 to PWN(PWN(Sigmoid_167), Mul_168)[Float(1,128,1,1)], Reformatted Input Tensor 1 to PWN(PWN(Sigmoid_167), Mul_168)[Float(1,128,18,32)] -> 601[Float(1,128,18,32)] Layer(Slice): Expand_174, Tactic: 0x0000000000000000, r4i[Float(1,1,1,1)] -> Reformatted Output Tensor 0 to Expand_174[Float(1,64,18,32)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to Expand_174, Tactic: 0x0000000000000000, Reformatted Output Tensor 0 to Expand_174[Float(1,64,18,32)] -> 609[Float(1,64,18,32)] Layer(Reformat): 606 copy, Tactic: 0x0000000000000000, 601[Float(1,64,18,32)] -> 609[Float(1,64,18,32)] Layer(NoOp): Reformatting CopyNode for Input Tensor 0 to Conv_176, Tactic: 0x0000000000000000, 609[Float(1,128,18,32)] -> Reformatted Input Tensor 0 to Conv_176[Float(1,128,18,32)] Layer(CaskConvolution): Conv_176, Tactic: 0xd4428a7355769d7d, Reformatted Input Tensor 0 to Conv_176[Float(1,128,18,32)] -> 610[Float(1,128,18,32)] Layer(PointWiseV2): PWN(Sigmoid_177), Tactic: 0x0000000000000005, 610[Float(1,128,18,32)] -> Reformatted Output Tensor 0 to PWN(Sigmoid_177)[Float(1,128,18,32)] Layer(NoOp): Reformatting CopyNode for Output Tensor 0 to PWN(Sigmoid_177), Tactic: 0x0000000000000000, Reformatted Output Tensor 0 to PWN(Sigmoid_177)[Float(1,128,18,32)] -> 611[Float(1,128,18,32)] Layer(ElementWise): Mul_179, Tactic: 0x0000000000000001, 611[Float(1,64,18,32)], 609[Float(1,64,18,32)] -> 615[Float(1,64,18,32)] Layer(Reformat): 606 copy (1), Tactic: 0x0000000000000000, 601[Float(1,64,18,32)] -> 615[Float(1,64,18,32)] Layer(CaskConvolution): Conv_181, Tactic: 0x818413b69874bb35, 615[Float(1,128,18,32)] -> 616[Float(1,64,18,32)] Layer(PointWiseV2): PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)), Tactic: 0x000000000000000a, 616[Float(1,64,18,32)], 611[Float(1,64,18,32)], 609[Float(1,64,18,32)] -> Reformatted Output Tensor 0 to PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187))[Float(1,64,18,32)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187)), Tactic: 0x0000000000000000, Reformatted Output Tensor 0 to PWN(PWN(PWN(Tanh_182), Mul_186), PWN(PWN(PWN(990 + (Unnamed Layer* 191) [Shuffle], Sub_184), Mul_185), Add_187))[Float(1,64,18,32)] -> r4o[Float(1,64,18,32)] Layer(Reformat): 605 copy, Tactic: 0x0000000000000000, 601[Float(1,64,18,32)] -> 623[Float(1,64,18,32)] Layer(Reformat): r4o copy, Tactic: 0x00000000000003e8, r4o[Float(1,64,18,32)] -> 623[Float(1,64,18,32)] Layer(Resize): Resize_190, Tactic: 0x0000000000000001, 623[Float(1,128,18,32)] -> 628[Float(1,128,36,64)] Layer(Reformat): 628 copy, Tactic: 0x00000000000003ea, 628[Float(1,128,36,64)] -> 637[Float(1,128,36,64)] Layer(Reformat): 464 copy, Tactic: 0x00000000000003e8, 464[Float(1,40,36,64)] -> 637[Float(1,40,36,64)] Layer(CaskConvolution): Conv_200 + Relu_201, Tactic: 0x21246c8544eff903, 637[Float(1,171,36,64)] -> Reformatted Output Tensor 0 to Conv_200 + Relu_201[Float(1,80,36,64)] Layer(NoOp): Reformatting CopyNode for Output Tensor 0 to Conv_200 + Relu_201, Tactic: 0x0000000000000000, Reformatted Output Tensor 0 to Conv_200 + Relu_201[Float(1,80,36,64)] -> 640[Float(1,80,36,64)] Layer(Slice): Expand_204, Tactic: 0x0000000000000000, r3i[Float(1,1,1,1)] -> Reformatted Output Tensor 0 to Expand_204[Float(1,40,36,64)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to Expand_204, Tactic: 0x0000000000000000, Reformatted Output Tensor 0 to Expand_204[Float(1,40,36,64)] -> 645[Float(1,40,36,64)] Layer(Reformat): 642 copy, Tactic: 0x00000000000003e8, 640[Float(1,40,36,64)] -> 645[Float(1,40,36,64)] Layer(NoOp): Reformatting CopyNode for Input Tensor 0 to Conv_206, Tactic: 0x0000000000000000, 645[Float(1,80,36,64)] -> Reformatted Input Tensor 0 to Conv_206[Float(1,80,36,64)] Layer(CaskConvolution): Conv_206, Tactic: 0x21246c8544eff903, Reformatted Input Tensor 0 to Conv_206[Float(1,80,36,64)] -> 646[Float(1,80,36,64)] Layer(PointWiseV2): PWN(Sigmoid_207), Tactic: 0x0000000000000008, 646[Float(1,80,36,64)] -> Reformatted Output Tensor 0 to PWN(Sigmoid_207)[Float(1,80,36,64)] Layer(NoOp): Reformatting CopyNode for Output Tensor 0 to PWN(Sigmoid_207), Tactic: 0x0000000000000000, Reformatted Output Tensor 0 to PWN(Sigmoid_207)[Float(1,80,36,64)] -> 647[Float(1,80,36,64)] Layer(ElementWise): Mul_209, Tactic: 0x0000000000000001, 647[Float(1,40,36,64)], 645[Float(1,40,36,64)] -> 651[Float(1,40,36,64)] Layer(Reformat): 642 copy (1), Tactic: 0x00000000000003e8, 640[Float(1,40,36,64)] -> 651[Float(1,40,36,64)] Layer(NoOp): Reformatting CopyNode for Input Tensor 0 to Conv_211, Tactic: 0x0000000000000000, 651[Float(1,80,36,64)] -> Reformatted Input Tensor 0 to Conv_211[Float(1,80,36,64)] Layer(CaskConvolution): Conv_211, Tactic: 0xa9a06d0633580c0c, Reformatted Input Tensor 0 to Conv_211[Float(1,80,36,64)] -> 652[Float(1,40,36,64)] Layer(NoOp): Reformatting CopyNode for Input Tensor 0 to PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)), Tactic: 0x0000000000000000, 652[Float(1,40,36,64)] -> Reformatted Input Tensor 0 to PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217))[Float(1,40,36,64)] Layer(PointWiseV2): PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)), Tactic: 0x000000000000001e, Reformatted Input Tensor 0 to PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217))[Float(1,40,36,64)], 647[Float(1,40,36,64)], 645[Float(1,40,36,64)] -> Reformatted Output Tensor 0 to PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217))[Float(1,40,36,64)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217)), Tactic: 0x00000000000003ea, Reformatted Output Tensor 0 to PWN(PWN(PWN(Tanh_212), Mul_216), PWN(PWN(PWN(990_clone_1 + (Unnamed Layer* 238) [Shuffle], Sub_214), Mul_215), Add_217))[Float(1,40,36,64)] -> r3o[Float(1,40,36,64)] Layer(Reformat): 641 copy, Tactic: 0x00000000000003ea, 640[Float(1,40,36,64)] -> 659[Float(1,40,36,64)] Layer(Reformat): r3o copy, Tactic: 0x0000000000000000, r3o[Float(1,40,36,64)] -> 659[Float(1,40,36,64)] Layer(Resize): Resize_220, Tactic: 0x0000000000000001, 659[Float(1,80,36,64)] -> 664[Float(1,80,72,128)] Layer(Reformat): 664 copy, Tactic: 0x00000000000003e8, 664[Float(1,80,72,128)] -> 673[Float(1,80,72,128)] Layer(Reformat): 420 copy, Tactic: 0x00000000000003e8, 420[Float(1,24,72,128)] -> 673[Float(1,24,72,128)] Layer(CaskConvolution): Conv_230 + Relu_231, Tactic: 0x94119b4c514b211a, 673[Float(1,107,72,128)] -> 676[Float(1,40,72,128)] Layer(Slice): Expand_234, Tactic: 0x0000000000000000, r2i[Float(1,1,1,1)] -> 681[Float(1,20,72,128)] Layer(Reformat): 678 copy, Tactic: 0x00000000000003e8, 676[Float(1,20,72,128)] -> 681[Float(1,20,72,128)] Layer(CaskConvolution): Conv_236, Tactic: 0x94119b4c514b211a, 681[Float(1,40,72,128)] -> 682[Float(1,40,72,128)] Layer(PointWiseV2): PWN(Sigmoid_237), Tactic: 0x0000000000000007, 682[Float(1,40,72,128)] -> 683[Float(1,40,72,128)] Layer(ElementWise): Mul_239, Tactic: 0x0000000000000001, 683[Float(1,20,72,128)], 681[Float(1,20,72,128)] -> 687[Float(1,20,72,128)] Layer(Reformat): 678 copy (1), Tactic: 0x00000000000003e8, 676[Float(1,20,72,128)] -> 687[Float(1,20,72,128)] Layer(CaskConvolution): Conv_241, Tactic: 0x94119b4c514b211a, 687[Float(1,40,72,128)] -> 688[Float(1,20,72,128)] Layer(PointWiseV2): PWN(PWN(PWN(Tanh_242), Mul_246), PWN(PWN(PWN(990_clone_2 + (Unnamed Layer* 285) [Shuffle], Sub_244), Mul_245), Add_247)), Tactic: 0x0000000000000008, 688[Float(1,20,72,128)], 683[Float(1,20,72,128)], 681[Float(1,20,72,128)] -> r2o[Float(1,20,72,128)] Layer(Reformat): 677 copy, Tactic: 0x00000000000003e8, 676[Float(1,20,72,128)] -> 695[Float(1,20,72,128)] Layer(Reformat): r2o copy, Tactic: 0x0000000000000000, r2o[Float(1,20,72,128)] -> 695[Float(1,20,72,128)] Layer(Resize): Resize_250, Tactic: 0x0000000000000001, 695[Float(1,40,72,128)] -> 700[Float(1,40,144,256)] Layer(Reformat): 700 copy, Tactic: 0x00000000000003e8, 700[Float(1,40,144,256)] -> 709[Float(1,40,144,256)] Layer(Reformat): 403 copy, Tactic: 0x00000000000003e8, 403[Float(1,16,144,256)] -> 709[Float(1,16,144,256)] Layer(CaskConvolution): Conv_260 + Relu_261, Tactic: 0x94119b4c514b211a, 709[Float(1,59,144,256)] -> 712[Float(1,32,144,256)] Layer(Slice): Expand_264, Tactic: 0x0000000000000000, r1i[Float(1,1,1,1)] -> 717[Float(1,16,144,256)] Layer(Reformat): 714 copy, Tactic: 0x00000000000003e8, 712[Float(1,16,144,256)] -> 717[Float(1,16,144,256)] Layer(CaskConvolution): Conv_266, Tactic: 0x94119b4c514b211a, 717[Float(1,32,144,256)] -> 718[Float(1,32,144,256)] Layer(PointWiseV2): PWN(Sigmoid_267), Tactic: 0x0000000000000005, 718[Float(1,32,144,256)] -> 719[Float(1,32,144,256)] Layer(ElementWise): Mul_269, Tactic: 0x0000000000000001, 719[Float(1,16,144,256)], 717[Float(1,16,144,256)] -> 723[Float(1,16,144,256)] Layer(Reformat): 714 copy (1), Tactic: 0x00000000000003e8, 712[Float(1,16,144,256)] -> 723[Float(1,16,144,256)] Layer(CaskConvolution): Conv_271, Tactic: 0x94119b4c514b211a, 723[Float(1,32,144,256)] -> 724[Float(1,16,144,256)] Layer(PointWiseV2): PWN(PWN(PWN(Tanh_272), Mul_276), PWN(PWN(PWN(990_clone_3 + (Unnamed Layer* 332) [Shuffle], Sub_274), Mul_275), Add_277)), Tactic: 0x0000000000000007, 724[Float(1,16,144,256)], 719[Float(1,16,144,256)], 717[Float(1,16,144,256)] -> r1o[Float(1,16,144,256)] Layer(Reformat): 713 copy, Tactic: 0x00000000000003e8, 712[Float(1,16,144,256)] -> 731[Float(1,16,144,256)] Layer(Reformat): r1o copy, Tactic: 0x0000000000000000, r1o[Float(1,16,144,256)] -> 731[Float(1,16,144,256)] Layer(Resize): Resize_280, Tactic: 0x0000000000000001, 731[Float(1,32,144,256)] -> 736[Float(1,32,288,512)] Layer(Reformat): 736 copy, Tactic: 0x00000000000003e8, 736[Float(1,32,288,512)] -> 745[Float(1,32,288,512)] Layer(Reformat): 389 copy (1), Tactic: 0x0000000000000000, 389[Float(1,3,288,512)] -> 745[Float(1,3,288,512)] Layer(CaskConvolution): Conv_290 + Relu_291, Tactic: 0x94119b4c514b211a, 745[Float(1,35,288,512)] -> 748[Float(1,16,288,512)] Layer(CaskConvolution): Conv_292 + Relu_293, Tactic: 0x94119b4c514b211a, 748[Float(1,16,288,512)] -> 770[Float(1,16,288,512)] Layer(CudnnConvolution): Conv_294, Tactic: 0x0000000000000001, 770[Float(1,16,288,512)] -> 752[Float(1,4,288,512)] Layer(Reformat): 753 copy, Tactic: 0x00000000000003e8, 752[Float(1,3,288,512)] -> 759[Float(1,3,288,512)] Layer(Reformat): 754 copy, Tactic: 0x0000000000000000, 752[Float(1,1,288,512)] -> 759[Float(1,1,288,512)] Layer(CudnnConvolution): Conv_302, Tactic: 0x0000000000000072, 759[Float(1,4,288,512)] -> 761[Float(1,4,288,512)] Layer(ElementWise): Mul_303, Tactic: 0x0000000000000001, 758[Float(1,4,288,512)], 759[Float(1,4,288,512)] -> 762[Float(1,4,288,512)] Layer(CudnnConvolution): Conv_304, Tactic: 0x0000000000000072, 762[Float(1,4,288,512)] -> 763[Float(1,4,288,512)] Layer(PointWiseV2): PWN(Mul_305, Sub_306), Tactic: 0x0000000000000004, 760[Float(1,4,288,512)], 761[Float(1,4,288,512)], 763[Float(1,4,288,512)] -> 765[Float(1,4,288,512)] Layer(Reformat): 765 copy, Tactic: 0x00000000000003e8, 765[Float(1,4,288,512)] -> 770[Float(1,4,288,512)] Layer(CaskConvolution): Conv_312 + Relu_313, Tactic: 0x9808072e706def96, 770[Float(1,24,288,512)] -> 773[Float(1,16,288,512)] Layer(CaskConvolution): Conv_314 + Relu_315, Tactic: 0x9808072e706def96, 773[Float(1,16,288,512)] -> 776[Float(1,16,288,512)] Layer(CudnnConvolution): Conv_316, Tactic: 0x0000000000000001, 776[Float(1,16,288,512)] -> 777[Float(1,4,288,512)] Layer(PointWiseV2): PWN(Mul_317, Sub_318), Tactic: 0x0000000000000004, 777[Float(1,4,288,512)], 760[Float(1,4,288,512)], 761[Float(1,4,288,512)] -> 779[Float(1,4,288,512)] Layer(Resize): Resize_332, Tactic: 0x0000000000000001, 777[Float(1,4,288,512)] -> 793[Float(1,4,1440,2560)] Layer(Resize): Resize_346, Tactic: 0x0000000000000001, 779[Float(1,4,288,512)] -> 807[Float(1,4,1440,2560)] Layer(PointWiseV2): PWN(Mul_347, Add_348), Tactic: 0x0000000000000006, 793[Float(1,4,1440,2560)], 756[Float(1,4,1440,2560)], 807[Float(1,4,1440,2560)] -> 809[Float(1,4,1440,2560)] Layer(PointWiseV2): PWN(Add_350, PWN(Clip_351)), Tactic: 0x0000000000000002, 809[Float(1,3,1440,2560)], Reformatted src[Float(1,3,1440,2560)] -> fgr[Float(1,3,1440,2560)] Layer(PointWiseV2): PWN(Clip_352), Tactic: 0x0000000000000009, 809[Float(1,1,1440,2560)] -> pha[Float(1,1,1440,2560)] [02/13/2023-19:58:58] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +0, GPU +18, now: CPU 0, GPU 18 (MiB) [02/13/2023-19:58:58] [W] [TRT] The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1. [02/13/2023-19:58:58] [W] [TRT] The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1. [02/13/2023-19:58:58] [I] Engine built in 540.589 sec. [02/13/2023-19:58:58] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 1551, GPU 10678 (MiB) [02/13/2023-19:58:58] [I] [TRT] Loaded engine size: 17 MiB [02/13/2023-19:58:58] [V] [TRT] Using cublasLt as a tactic source [02/13/2023-19:58:58] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +9, now: CPU 1561, GPU 10699 (MiB) [02/13/2023-19:58:58] [V] [TRT] Using cuDNN as a tactic source [02/13/2023-19:58:58] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +9, now: CPU 1561, GPU 10708 (MiB) [02/13/2023-19:58:58] [V] [TRT] Deserialization required 50259 microseconds. [02/13/2023-19:58:58] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +17, now: CPU 0, GPU 17 (MiB) [02/13/2023-19:58:58] [I] Engine deserialized in 0.0535805 sec. [02/13/2023-19:58:58] [V] [TRT] Using cublasLt as a tactic source [02/13/2023-19:58:58] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +5, now: CPU 1561, GPU 10701 (MiB) [02/13/2023-19:58:58] [V] [TRT] Using cuDNN as a tactic source [02/13/2023-19:58:58] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +1, GPU +9, now: CPU 1562, GPU 10710 (MiB) [02/13/2023-19:58:58] [V] [TRT] Total per-runner device persistent memory is 2673152 [02/13/2023-19:58:58] [V] [TRT] Total per-runner host persistent memory is 162464 [02/13/2023-19:58:58] [V] [TRT] Allocated activation device memory of size 258454528 [02/13/2023-19:58:58] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +249, now: CPU 0, GPU 266 (MiB) Segmentation fault (core dumped) (venv) tech@Artax:/opt/metamirror/onnx_trt_utils$